Apr 29 18:03:26 devstack cinder-volume[75733]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75733) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:03:26 devstack cinder-volume[75733]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75733) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:03:26 devstack cinder-volume[75733]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75733) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:03:27 devstack cinder-volume[75733]: INFO dbcounter [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Registered counter for database cinder Apr 29 18:03:27 devstack cinder-volume[75733]: DEBUG oslo_db.sqlalchemy.engines [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75733) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:03:27 devstack cinder-volume[75733]: DEBUG dbcounter [-] [75733] Writer thread running {{(pid=75733) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:03:27 devstack cinder-volume[75733]: INFO cinder.rpc [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 18:03:27 devstack cinder-volume[75733]: INFO cinder.rpc [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 18:03:27 devstack cinder-volume[75733]: DEBUG oslo_db.sqlalchemy.engines [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75733) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:03:27 devstack cinder-volume[75733]: INFO cinder.volume.manager [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Determined volume DB was empty at startup. Apr 29 18:03:27 devstack cinder-volume[75733]: DEBUG cinder.volume.manager [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75733) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 18:03:27 devstack cinder-volume[75733]: INFO cinder.volume.manager [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 18:03:27 devstack cinder-volume[75733]: WARNING stevedore.named [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:03:27 devstack cinder-volume[75733]: WARNING castellan.key_manager [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:03:27 devstack cinder-volume[75733]: WARNING cinder.keymgr.conf_key_mgr [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:03:27 devstack cinder-volume[75733]: DEBUG cinder.volume.drivers.lvm [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75733) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 18:03:27 devstack cinder-volume[75733]: DEBUG oslo_concurrency.processutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75733) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_concurrency.processutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] CMD "cinder-rtstool verify" returned: 0 in 0.389s {{(pid=75733) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_db.sqlalchemy.engines [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75733) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:03:28 devstack cinder-volume[75733]: INFO cinder.rpc [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 18:03:28 devstack cinder-volume[75733]: INFO cinder.rpc [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 18:03:28 devstack cinder-volume[75733]: WARNING stevedore.named [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:03:28 devstack cinder-volume[75733]: WARNING castellan.key_manager [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:03:28 devstack cinder-volume[75733]: INFO cinder.volume.manager [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_db.sqlalchemy.engines [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75733) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:03:28 devstack cinder-volume[75733]: INFO oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Starting 1 workers Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Started child 75905 {{(pid=75733) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Full set of CONF: {{(pid=75733) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] ******************************************************************************** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Configuration options gathered from: {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] ================================================================================ {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] allow_availability_zone_fallback = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] allow_compression_on_image_upload = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] allowed_direct_url_schemes = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] api_rate_limit = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] auth_strategy = keystone {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] az_cache_duration = 3600 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75905]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_availability_zone = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_host = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_stats_polling_interval = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backup_api_class = cinder.backup.api.API {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backup_name_template = backup-%s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backup_use_same_host = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backup_use_temp_snapshot = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] chap_password = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] chap_username = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_internal_tenant_project_id = 08503a105820486b859c6cc7f45968dc {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_internal_tenant_user_id = 8267fb722cbb420092dbaa67552e6aa8 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cloned_volume_same_az = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cluster = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] compression_format = gzip {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] compute_api_class = cinder.compute.nova.API {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] config_dir = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] config_source = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] control_exchange = openstack {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] debug = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] default_availability_zone = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] default_group_type = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] default_volume_type = lvmdriver-1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] disk_geometry = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] driver_client_cert = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] driver_client_cert_key = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] driver_data_namespace = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] driver_ssl_cert_path = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] driver_ssl_cert_verify = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] driver_use_ssl = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] enable_force_upload = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] enable_new_services = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] enable_unsupported_driver = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] enforce_multipath_for_image_xfer = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] filter_function = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_api_insecure = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_api_ssl_compression = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_ca_certificates_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_catalog_info = image:glance:publicURL {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_num_retries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance_request_timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] goodness_function = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] graceful_shutdown_timeout = 5 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] group_api_class = cinder.group.api.API {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] host = devstack {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_compress_on_upload = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_conversion_address_space_limit = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_conversion_cpu_limit = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_conversion_disable = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_upload_use_cinder_backend = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_upload_use_internal_tenant = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_volume_cache_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_volume_cache_max_count = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] image_volume_cache_max_size_gb = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] init_host_max_objects_retrieval = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] instance_format = [instance: %(uuid)s] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] iscsi_target_flags = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] iscsi_write_cache = on {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] iser_helper = tgtadm {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] iser_ip_address = 192.168.122.50 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] iser_port = 3260 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_color = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_config_append = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_dir = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_options = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_rotate_interval = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_rotate_interval_type = days {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] log_rotation_type = none {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] max_age = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] max_logfile_count = 30 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] max_logfile_size_mb = 200 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] max_over_subscription_ratio = 20.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] message_reap_interval = 86400 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] message_ttl = 2592000 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] migration_create_volume_timeout_secs = 300 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack sudo[75909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] monkey_patch = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] monkey_patch_modules = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] my_ip = 192.168.122.50 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] no_snapshot_gb_quota = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] num_iser_scan_tries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] num_shell_tries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] num_volume_device_scan_tries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack sudo[75909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] nvmeof_conn_info_version = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] nvmet_ns_id = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] nvmet_port_id = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_max_limit = 1000 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_volume_ext_list = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_volume_listen_port = 8776 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_volume_use_ssl = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] osapi_volume_workers = 2 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] per_volume_size_limit = -1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] periodic_fuzzy_delay = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] periodic_interval = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] public_endpoint = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] publish_errors = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_backup_gigabytes = 1000 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_backups = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_gigabytes = 1000 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_groups = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_snapshots = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] quota_volumes = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] rate_limit_burst = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] rate_limit_except_level = CRITICAL {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] rate_limit_interval = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] reinit_driver_count = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] replication_device = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] report_discard_supported = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] report_interval = 120 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] reservation_clean_interval = 86400 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] reservation_expire = 86400 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] reserved_image_namespaces = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] reserved_percentage = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] rpc_response_timeout = 120 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] run_external_periodic_tasks = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] scst_target_driver = iscsi {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] scst_target_iqn_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_down_time = 720 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] shell_completion = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] snapshot_name_template = snapshot-%s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] snapshot_same_host = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] split_loggers = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] state_path = /opt/stack/data/cinder {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] storage_availability_zone = nova {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] storage_protocol = iSCSI {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] syslog_log_facility = LOG_USER {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] target_helper = lioadm {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] target_ip_address = 192.168.122.50 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] target_port = 3260 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] target_protocol = iscsi {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] target_secondary_ip_addresses = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] trace_flags = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] transport_url = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] until_refresh = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_chap_auth = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_default_quota_class = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_journal = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_json = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_multipath_for_image_xfer = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_stderr = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] use_syslog = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] verify_glance_signatures = enabled {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_api_class = cinder.volume.api.API {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_backend_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_clear = zero {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_clear_ionice = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_clear_size = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_copy_bps_limit = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_dd_blocksize = 1M {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_name_template = volume-%s {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_service_inithost_offload = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volume_usage_audit_period = month {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] zoning_mode = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_concurrency.disable_process_locking = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.admin_password = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.admin_token = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.admin_user = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_port = 35357 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_protocol = https {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_section = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_type = password {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_uri = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.auth_version = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.cache = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.identity_uri = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.include_service_catalog = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.insecure = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.interface = public {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_password = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcache_username = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.region_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.service_type = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.backend = dogpile.cache.null {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.backend_argument = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.backend_expiration_time = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.config_prefix = cache.oslo {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.debug_cache_backend = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.enable_retry_client = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.enable_socket_keepalive = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.enforce_fips_mode = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.expiration_time = 600 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.hashclient_retry_attempts = 2 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_dead_retry = 300 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_pool_maxsize = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_sasl_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.password = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.proxies = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.redis_db = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.redis_server = localhost:6379 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.retry_attempts = 2 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.retry_delay = 0.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.socket_keepalive_count = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.socket_keepalive_idle = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.socket_keepalive_interval = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.socket_timeout = 1.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.tls_allowed_ciphers = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.tls_cafile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.tls_certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.tls_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.tls_keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cache.username = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] coordination.backend_url = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.asyncio_connection = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.asyncio_slave_connection = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.backend = sqlalchemy {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.connection = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.connection_debug = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.connection_parameters = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.connection_recycle_time = 3600 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.connection_trace = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.db_inc_retry_interval = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.db_max_retries = 20 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.db_max_retry_interval = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.db_retry_interval = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.max_overflow = 50 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.max_pool_size = 5 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.max_retries = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.mysql_wsrep_sync_wait = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.pool_timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.retry_interval = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.slave_connection = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.sqlite_synchronous = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.synchronous_reader = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] database.use_db_reconnect = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.connection_string = messaging:// {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.es_doc_type = notification {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.es_scroll_size = 10000 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.es_scroll_time = 2m {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.filter_error_trace = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.hmac_keys = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.sentinel_service_name = mymaster {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.socket_timeout = 0.1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.trace_requests = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler.trace_sqlalchemy = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler_jaeger.process_tags = {} {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:28 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler_jaeger.service_name_prefix = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] profiler_otlp.service_name_prefix = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.enforce_new_defaults = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: WARNING oslo_config.cfg [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.enforce_scope = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.policy_default_rule = default {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.policy_file = policy.yaml {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.group = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.helper_command = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] privsep_osbrick.user = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.group = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.helper_command = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] cinder_sys_admin.user = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.auth_section = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.auth_type = password {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.cafile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.collect_timing = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.insecure = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.send_service_user_token = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.split_loggers = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] service_user.timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.auth_section = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.auth_type = password {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.collect_timing = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.insecure = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.region_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.split_loggers = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] glance.timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.backend_availability_zone = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.chap_password = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.chap_username = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.disk_geometry = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.driver_client_cert = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.driver_client_cert_key = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.driver_data_namespace = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.driver_use_ssl = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.extra_capabilities = {} {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.filter_function = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack sudo[75909]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.goodness_function = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.iscsi_target_flags = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.iscsi_write_cache = on {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.iser_helper = tgtadm {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.iser_port = 3260 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.lvm_share_target = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.lvm_type = auto {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack sudo[76028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.num_shell_tries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.replication_device = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack sudo[76028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.report_discard_supported = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.reserved_percentage = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.target_helper = tgtadm {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.target_port = 3260 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.target_protocol = iscsi {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.trace_flags = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.unique_fqdn_network = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.use_chap_auth = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_backend_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_clear = zero {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_clear_ionice = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_clear_size = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_reports.file_event_handler = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_reports.log_dir = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.backend_host = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.chap_password = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.chap_username = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.disk_geometry = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.driver_client_cert = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.extra_capabilities = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.filter_function = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.goodness_function = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.iser_helper = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.iser_ip_address = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.iser_port = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.lvm_share_target = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.lvm_type = auto {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.num_shell_tries = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.replication_device = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.report_discard_supported = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.reserved_percentage = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.scst_target_driver = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.storage_protocol = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.target_helper = lioadm {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.target_ip_address = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.target_port = 3260 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.trace_flags = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.use_chap_auth = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_clear = zero {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_clear_size = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] lvmdriver-1.volumes_dir = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.ssl = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_notifications.driver = [] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_notifications.retry = -1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] key_manager.fixed_key = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.barbican_api_version = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.barbican_endpoint = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.barbican_endpoint_type = public {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.barbican_region_name = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.cafile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.collect_timing = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.insecure = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.number_of_retries = 60 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.retry_delay = 1 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.send_service_user_token = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.split_loggers = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.verify_ssl = True {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican.verify_ssl_path = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.auth_section = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.auth_type = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.cafile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.certfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.collect_timing = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.insecure = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.keyfile = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.split_loggers = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] barbican_service_user.timeout = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.approle_role_id = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.approle_secret_id = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.kv_mountpoint = secret {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.kv_path = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.kv_version = 2 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.namespace = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.root_token_id = **** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.ssl_ca_crt_file = None {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.timeout = 60.0 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.use_ssl = False {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:03:29 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] ******************************************************************************** {{(pid=75733) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.782s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:29 devstack sudo[76028]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.652s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:03:29 devstack cinder-volume[75905]: INFO cinder.brick.local_dev.lvm [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:29 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:29 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:03:29 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:30 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:30 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:30 devstack cinder-volume[75905]: DEBUG cinder.brick.local_dev.lvm [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75905) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 18:03:30 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:30 devstack sudo[76398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:30 devstack sudo[76398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:31 devstack sudo[76398]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:31 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.471s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:31 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:31 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:31 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:31 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:31 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:32 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:32 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.867s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:32 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:32 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:32 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:32 devstack sudo[76687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 18:03:32 devstack sudo[76687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:33 devstack sudo[76687]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:33 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.599s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:33 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:33 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:03:33 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:34 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:34 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:34 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:34 devstack sudo[76694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:03:34 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:34 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:34 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:34 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:34 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:34 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:35 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:35 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:35 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:35 devstack sudo[76702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:35 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:35 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:35 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:35 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:35 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:35 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:36 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:36 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:36 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:36 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:36 devstack cinder-volume[75905]: INFO cinder.volume.drivers.lvm [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 18:03:36 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:36 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:36 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:36 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:36 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:37 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:37 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.910s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:37 devstack cinder-volume[75905]: DEBUG cinder.volume.drivers.lvm [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Updating volume stats {{(pid=75905) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:03:37 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:37 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:03:37 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:38 devstack cinder-volume[75733]: DEBUG dbcounter [-] [75733] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75733) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:03:38 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:38 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:38 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:38 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:38 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:38 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:38 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:38 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:38 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:38 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:39 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:39 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.582s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:39 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:39 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:39 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:40 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:40 devstack cinder-volume[75905]: INFO cinder.volume.driver [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG cinder.volume.driver [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75905) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG oslo_db.sqlalchemy.engines [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG dbcounter [-] [75905] Writer thread running {{(pid=75905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG cinder.db.sqlalchemy.api [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Building query based on filter {{(pid=75905) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG cinder.image.image_utils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75905) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 18:03:40 devstack cinder-volume[75905]: INFO cinder.keymgr.migration [None req-44b71759-1f92-426b-9eef-39941d6c93f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG cinder.volume.drivers.lvm [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Updating volume stats {{(pid=75905) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:40 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:03:40 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:40 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:40 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:40 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:40 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:41 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:41 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:41 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:41 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:41 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:42 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:42 devstack sudo[77001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:42 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:42 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG cinder.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Notifying Schedulers of capabilities ... {{(pid=75905) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:03:42 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Driver initialization completed successfully. Apr 29 18:03:42 devstack cinder-volume[75905]: INFO cinder.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Initiating service 2 cleanup Apr 29 18:03:42 devstack cinder-volume[75905]: INFO cinder.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Service 2 cleanup completed. Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG cinder.service [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Creating RPC server for service cinder-volume {{(pid=75905) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG cinder.service [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75905) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 18:03:42 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG cinder.volume.drivers.lvm [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Updating volume stats {{(pid=75905) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:03:42 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:43 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:03:43 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:43 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:43 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:43 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:43 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:43 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:44 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:44 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:44 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:44 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:03:44 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:44 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:44 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:44 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:03:44 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:03:44 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:03:45 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Apr 29 18:03:45 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:03:45 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-605842a8-8695-404b-88fe-912ad4e2b4a5 None None] Driver post RPC initialization completed successfully. Apr 29 18:03:55 devstack cinder-volume[75905]: DEBUG dbcounter [-] [75905] Writing DB stats cinder:SELECT=4 {{(pid=75905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:03:55 devstack cinder-volume[75905]: DEBUG dbcounter [-] [75905] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:04:54 devstack cinder-volume[75905]: DEBUG oslo_service.periodic_task [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75905) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:04:54 devstack cinder-volume[75905]: DEBUG cinder.volume.drivers.lvm [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Updating volume stats {{(pid=75905) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:04:54 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:04:54 devstack sudo[79271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:04:54 devstack sudo[79271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:04:55 devstack sudo[79271]: pam_unix(sudo:session): session closed for user root Apr 29 18:04:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:04:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:04:55 devstack sudo[79277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:04:55 devstack sudo[79277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:04:55 devstack sudo[79277]: pam_unix(sudo:session): session closed for user root Apr 29 18:04:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:04:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:04:55 devstack sudo[79280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:04:55 devstack sudo[79280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:04:56 devstack sudo[79280]: pam_unix(sudo:session): session closed for user root Apr 29 18:04:56 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:04:56 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:04:56 devstack sudo[79283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:04:56 devstack sudo[79283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:04:57 devstack sudo[79283]: pam_unix(sudo:session): session closed for user root Apr 29 18:04:57 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:04:57 devstack cinder-volume[75905]: DEBUG cinder.manager [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Notifying Schedulers of capabilities ... {{(pid=75905) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:05:54 devstack cinder-volume[75905]: DEBUG oslo_service.periodic_task [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75905) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:05:54 devstack cinder-volume[75905]: DEBUG cinder.volume.drivers.lvm [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Updating volume stats {{(pid=75905) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:05:54 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:05:54 devstack sudo[82162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:05:54 devstack sudo[82162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:05:55 devstack sudo[82162]: pam_unix(sudo:session): session closed for user root Apr 29 18:05:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:05:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:05:55 devstack sudo[82165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:05:55 devstack sudo[82165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:05:55 devstack cinder-volume[75905]: DEBUG dbcounter [-] [75905] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:05:55 devstack sudo[82165]: pam_unix(sudo:session): session closed for user root Apr 29 18:05:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:05:55 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:05:55 devstack sudo[82171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:05:55 devstack sudo[82171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:05:56 devstack sudo[82171]: pam_unix(sudo:session): session closed for user root Apr 29 18:05:56 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:05:56 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:05:56 devstack sudo[82174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:05:56 devstack sudo[82174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:05:57 devstack sudo[82174]: pam_unix(sudo:session): session closed for user root Apr 29 18:05:57 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:05:57 devstack cinder-volume[75905]: DEBUG cinder.manager [None req-d312bccd-5c00-4700-a4d5-654906f59400 None None] Notifying Schedulers of capabilities ... {{(pid=75905) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:06:32 devstack cinder-volume[75733]: INFO oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Caught SIGTERM, stopping children Apr 29 18:06:32 devstack cinder-volume[75733]: DEBUG oslo_concurrency.lockutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Acquiring lock "singleton_lock" {{(pid=75733) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:06:32 devstack cinder-volume[75733]: DEBUG oslo_concurrency.lockutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Acquired lock "singleton_lock" {{(pid=75733) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:06:32 devstack cinder-volume[75733]: DEBUG oslo_concurrency.lockutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Releasing lock "singleton_lock" {{(pid=75733) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:06:32 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Stop services. {{(pid=75733) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 18:06:32 devstack cinder-volume[75733]: DEBUG oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Killing children. {{(pid=75733) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 18:06:32 devstack cinder-volume[75733]: INFO oslo_service.backend._eventlet.service [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Waiting on 1 children to exit Apr 29 18:06:37 devstack cinder-volume[75905]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 29 18:06:37 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Acquiring lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:06:37 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Acquired lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:06:37 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Releasing lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:06:38 devstack cinder-volume[75905]: WARNING amqp [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:06:38 devstack cinder-volume[75905]: WARNING amqp [None req-9b51e534-a2e8-4c53-90cd-29aeed835207 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:06:40 devstack cinder-volume[83600]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:06:40 devstack cinder-volume[83600]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:06:40 devstack cinder-volume[83600]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:06:40 devstack cinder-volume[83600]: INFO dbcounter [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Registered counter for database cinder Apr 29 18:06:40 devstack cinder-volume[83600]: DEBUG oslo_db.sqlalchemy.engines [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG dbcounter [-] [83600] Writer thread running {{(pid=83600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:06:41 devstack cinder-volume[83600]: INFO cinder.rpc [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 18:06:41 devstack cinder-volume[83600]: INFO cinder.rpc [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_db.sqlalchemy.engines [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:41 devstack cinder-volume[83600]: INFO cinder.volume.manager [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Determined volume DB was empty at startup. Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG cinder.volume.manager [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83600) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 18:06:41 devstack cinder-volume[83600]: INFO cinder.volume.manager [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 18:06:41 devstack cinder-volume[83600]: WARNING stevedore.named [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:06:41 devstack cinder-volume[83600]: WARNING castellan.key_manager [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:06:41 devstack cinder-volume[83600]: WARNING cinder.keymgr.conf_key_mgr [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:06:41 devstack cinder-volume[83600]: INFO cinder.volume.manager [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_db.sqlalchemy.engines [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:41 devstack cinder-volume[83600]: INFO oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Starting 1 workers Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Started child 83867 {{(pid=83600) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Full set of CONF: {{(pid=83600) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] ******************************************************************************** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Configuration options gathered from: {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] ================================================================================ {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] allow_availability_zone_fallback = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] allow_compression_on_image_upload = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] allowed_direct_url_schemes = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] api_rate_limit = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] auth_strategy = keystone {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_availability_zone = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83867]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_host = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_stats_polling_interval = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backup_api_class = cinder.backup.api.API {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backup_name_template = backup-%s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backup_use_same_host = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backup_use_temp_snapshot = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] chap_password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] chap_username = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_internal_tenant_project_id = 08503a105820486b859c6cc7f45968dc {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_internal_tenant_user_id = 8267fb722cbb420092dbaa67552e6aa8 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cluster = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] compression_format = gzip {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] compute_api_class = cinder.compute.nova.API {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] config_dir = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] config_source = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] control_exchange = openstack {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] debug = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] default_availability_zone = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] default_group_type = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] default_volume_type = QuobyteHD {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] disk_geometry = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] driver_client_cert = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] driver_client_cert_key = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] driver_data_namespace = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] driver_ssl_cert_path = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] driver_ssl_cert_verify = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] driver_use_ssl = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] enable_new_services = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] enable_unsupported_driver = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] enabled_backends = ['QuobyteHD'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] enforce_multipath_for_image_xfer = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] filter_function = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_api_insecure = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_api_ssl_compression = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_ca_certificates_file = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_catalog_info = image:glance:publicURL {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_num_retries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance_request_timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] goodness_function = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] graceful_shutdown_timeout = 5 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] group_api_class = cinder.group.api.API {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] host = devstack {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_compress_on_upload = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_conversion_address_space_limit = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_conversion_cpu_limit = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_conversion_disable = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_upload_use_cinder_backend = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_upload_use_internal_tenant = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_volume_cache_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_volume_cache_max_count = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] image_volume_cache_max_size_gb = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] init_host_max_objects_retrieval = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] instance_format = [instance: %(uuid)s] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] iscsi_target_flags = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] iscsi_write_cache = on {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] iser_helper = tgtadm {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] iser_ip_address = 192.168.122.50 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] iser_port = 3260 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_color = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_config_append = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_dir = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_file = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_options = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_rotate_interval = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_rotate_interval_type = days {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] log_rotation_type = none {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] max_age = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] max_logfile_count = 30 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] max_logfile_size_mb = 200 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] max_over_subscription_ratio = 20.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] message_reap_interval = 86400 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] message_ttl = 2592000 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] migration_create_volume_timeout_secs = 300 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] monkey_patch = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] monkey_patch_modules = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] my_ip = 192.168.122.50 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] no_snapshot_gb_quota = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] num_iser_scan_tries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] num_shell_tries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] num_volume_device_scan_tries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83867]: INFO cinder.volume.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 18:06:41 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.remotefs [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83867) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] nvmeof_conn_info_version = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] nvmet_ns_id = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] nvmet_port_id = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_max_limit = 1000 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_volume_ext_list = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_volume_listen_port = 8776 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_volume_use_ssl = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] osapi_volume_workers = 2 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] per_volume_size_limit = -1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] periodic_fuzzy_delay = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] periodic_interval = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] public_endpoint = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] publish_errors = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_backup_gigabytes = 1000 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_backups = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_gigabytes = 1000 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_groups = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_snapshots = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] quota_volumes = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] rate_limit_burst = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] rate_limit_except_level = CRITICAL {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] rate_limit_interval = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] reinit_driver_count = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] replication_device = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] report_discard_supported = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] report_interval = 120 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] reservation_clean_interval = 86400 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] reservation_expire = 86400 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] reserved_image_namespaces = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] reserved_percentage = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] rpc_response_timeout = 120 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] run_external_periodic_tasks = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] scst_target_driver = iscsi {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] scst_target_iqn_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_down_time = 720 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] shell_completion = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] snapshot_name_template = snapshot-%s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] split_loggers = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] state_path = /opt/stack/data/cinder {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] storage_availability_zone = nova {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] storage_protocol = iSCSI {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] syslog_log_facility = LOG_USER {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] target_helper = lioadm {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] target_ip_address = 192.168.122.50 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] target_port = 3260 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] target_protocol = iscsi {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] target_secondary_ip_addresses = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] trace_flags = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] transport_url = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] until_refresh = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_chap_auth = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_default_quota_class = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_journal = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_json = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_multipath_for_image_xfer = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_stderr = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] use_syslog = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] verify_glance_signatures = enabled {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_api_class = cinder.volume.api.API {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_backend_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_clear = zero {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_clear_ionice = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_clear_size = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_copy_bps_limit = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_dd_blocksize = 1M {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_name_template = volume-%s {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_service_inithost_offload = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volume_usage_audit_period = month {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] zoning_mode = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_concurrency.disable_process_locking = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.admin_password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.admin_token = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.admin_user = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_port = 35357 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_protocol = https {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_section = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_type = password {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_uri = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.auth_version = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.cache = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.identity_uri = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.include_service_catalog = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.insecure = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.interface = public {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_password = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcache_username = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.region_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.service_type = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.backend = dogpile.cache.null {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.backend_argument = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.backend_expiration_time = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.config_prefix = cache.oslo {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.debug_cache_backend = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.enable_retry_client = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.enable_socket_keepalive = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.enforce_fips_mode = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.expiration_time = 600 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.hashclient_retry_attempts = 2 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_dead_retry = 300 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_pool_maxsize = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_sasl_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.proxies = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.redis_db = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.redis_server = localhost:6379 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.retry_attempts = 2 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.retry_delay = 0.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.socket_keepalive_count = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.socket_keepalive_idle = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.socket_keepalive_interval = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.socket_timeout = 1.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.tls_allowed_ciphers = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.tls_cafile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.tls_certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.tls_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.tls_keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cache.username = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] coordination.backend_url = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.asyncio_connection = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.asyncio_slave_connection = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.backend = sqlalchemy {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.connection = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.connection_debug = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.connection_parameters = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.connection_recycle_time = 3600 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.connection_trace = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.db_inc_retry_interval = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.db_max_retries = 20 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.db_max_retry_interval = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.db_retry_interval = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.max_overflow = 50 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.max_pool_size = 5 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.max_retries = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.mysql_wsrep_sync_wait = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.pool_timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.retry_interval = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.slave_connection = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.sqlite_synchronous = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.synchronous_reader = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] database.use_db_reconnect = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.connection_string = messaging:// {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.es_doc_type = notification {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.es_scroll_size = 10000 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.es_scroll_time = 2m {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.filter_error_trace = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.hmac_keys = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.sentinel_service_name = mymaster {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.socket_timeout = 0.1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.trace_requests = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler.trace_sqlalchemy = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler_jaeger.process_tags = {} {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler_jaeger.service_name_prefix = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] profiler_otlp.service_name_prefix = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.enforce_new_defaults = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: WARNING oslo_config.cfg [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.enforce_scope = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.policy_default_rule = default {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.policy_file = policy.yaml {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.group = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.helper_command = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] privsep_osbrick.user = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.group = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83867) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 18:06:41 devstack cinder-volume[83867]: WARNING cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 18:06:41 devstack cinder-volume[83867]: WARNING cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.helper_command = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] cinder_sys_admin.user = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.auth_section = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.auth_type = password {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.cafile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.collect_timing = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.insecure = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.send_service_user_token = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Running cmd (subprocess): mount.quobyte {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.split_loggers = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] service_user.timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.auth_section = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.auth_type = password {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.collect_timing = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.insecure = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.region_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.split_loggers = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] glance.timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.backend_availability_zone = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.chap_password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.chap_username = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.disk_geometry = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.driver_client_cert = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.driver_client_cert_key = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.driver_data_namespace = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.driver_use_ssl = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.extra_capabilities = {} {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.filter_function = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.goodness_function = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.iscsi_target_flags = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.iscsi_write_cache = on {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.iser_helper = tgtadm {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.iser_port = 3260 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_host = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_login = admin {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_mount_options = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_private_key = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_share_path = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.num_shell_tries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.quobyte_volume_url = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.replication_device = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.report_discard_supported = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.reserved_percentage = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.target_helper = tgtadm {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.target_port = 3260 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.target_protocol = iscsi {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.trace_flags = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.unique_fqdn_network = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.use_chap_auth = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_backend_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_clear = zero {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_clear_ionice = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_clear_size = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_reports.file_event_handler = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_reports.log_dir = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.backend_availability_zone = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.backend_host = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.chap_password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.chap_username = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.chiscsi_conf = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.disk_geometry = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.driver_client_cert = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.driver_data_namespace = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.driver_use_ssl = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.extra_capabilities = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.filter_function = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.goodness_function = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.iser_helper = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.iser_ip_address = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.iser_port = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.iser_target_prefix = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_host = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_login = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_mount_options = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_password = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_private_key = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_share_path = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_ssh_port = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.num_shell_tries = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.nvmet_port_id = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.replication_device = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.report_discard_supported = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.reserved_percentage = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.scst_target_driver = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.storage_protocol = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:41 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.target_helper = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.target_ip_address = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.target_port = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.target_prefix = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.target_protocol = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.trace_flags = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.use_chap_auth = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_clear = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_clear_size = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] QuobyteHD.volumes_dir = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.ssl = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_notifications.driver = [] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_notifications.retry = -1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] key_manager.fixed_key = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.barbican_api_version = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.barbican_endpoint = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.barbican_endpoint_type = public {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.barbican_region_name = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.cafile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.collect_timing = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.insecure = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.number_of_retries = 60 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.retry_delay = 1 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.send_service_user_token = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.split_loggers = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.verify_ssl = True {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican.verify_ssl_path = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.auth_section = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.auth_type = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.cafile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.certfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.collect_timing = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.insecure = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.keyfile = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.split_loggers = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] barbican_service_user.timeout = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.approle_role_id = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.approle_secret_id = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.kv_mountpoint = secret {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.kv_path = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.kv_version = 2 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.namespace = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.root_token_id = **** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.ssl_ca_crt_file = None {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.timeout = 60.0 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.use_ssl = False {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:42 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] ******************************************************************************** {{(pid=83600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 18:06:42 devstack quobyte-client[83896]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 18:06:42 devstack quobyte-client[83896]: Invalid parameters found, error: missing mount point. Apr 29 18:06:42 devstack quobyte-client[83896]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 18:06:42 devstack quobyte-client[83896]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] CMD "mount.quobyte" returned: 1 in 0.139s {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=83867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:42 devstack cinder-volume[83867]: INFO cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 ... Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 -c /etc/quobyte/client-cinder.cfg {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:42 devstack sudo[83897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 -c /etc/quobyte/client-cinder.cfg Apr 29 18:06:42 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:42 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.784s {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:42 devstack cinder-volume[83867]: INFO cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 succeeded Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=83867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.799s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:42 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:42 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:42 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:43 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.591s {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:43 devstack cinder-volume[83867]: INFO cinder.volume.driver [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG cinder.volume.driver [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5614433288574, 'free_capacity_gb': 1775.5614433288574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83867) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG oslo_db.sqlalchemy.engines [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG dbcounter [-] [83867] Writer thread running {{(pid=83867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG cinder.db.sqlalchemy.api [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Building query based on filter {{(pid=83867) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG cinder.image.image_utils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83867) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 18:06:43 devstack cinder-volume[83867]: INFO cinder.keymgr.migration [None req-e749d12e-64f9-4b86-ad47-7220710c91bd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=83867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=83867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:43 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:43 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:43 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:44 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.616s {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG cinder.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Notifying Schedulers of capabilities ... {{(pid=83867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:06:44 devstack cinder-volume[83867]: INFO cinder.volume.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Driver initialization completed successfully. Apr 29 18:06:44 devstack cinder-volume[83867]: INFO cinder.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Initiating service 3 cleanup Apr 29 18:06:44 devstack cinder-volume[83867]: INFO cinder.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Service 3 cleanup completed. Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG cinder.service [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Creating RPC server for service cinder-volume {{(pid=83867) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG cinder.service [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83867) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 18:06:44 devstack cinder-volume[83867]: INFO cinder.volume.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=83867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=83867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:44 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:44 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:44 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:45 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:45 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.689s {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:45 devstack cinder-volume[83867]: INFO cinder.volume.manager [None req-9329d0f0-e82e-423d-84db-c42a3ccaacc0 None None] Driver post RPC initialization completed successfully. Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=83867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG cinder.volume.drivers.quobyte [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=83867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:49 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:49 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:49 devstack cinder-volume[83600]: INFO oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Caught SIGTERM, stopping children Apr 29 18:06:49 devstack cinder-volume[83600]: DEBUG oslo_concurrency.lockutils [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Acquiring lock "singleton_lock" {{(pid=83600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:06:49 devstack cinder-volume[83600]: DEBUG oslo_concurrency.lockutils [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Acquired lock "singleton_lock" {{(pid=83600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:06:49 devstack cinder-volume[83600]: DEBUG oslo_concurrency.lockutils [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Releasing lock "singleton_lock" {{(pid=83600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:06:49 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Stop services. {{(pid=83600) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 18:06:49 devstack cinder-volume[83600]: DEBUG oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Killing children. {{(pid=83600) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 18:06:49 devstack cinder-volume[83600]: INFO oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Waiting on 1 children to exit Apr 29 18:06:49 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG oslo_concurrency.processutils [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.802s {{(pid=83867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:49 devstack cinder-volume[83867]: DEBUG cinder.manager [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Notifying Schedulers of capabilities ... {{(pid=83867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Unable to connect to AMQP server on 192.168.122.50:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server [None req-90a9f4ba-a9b6-46db-b547-3b836aeb3fa1 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.50:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server method() Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return _publish( Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server listener(*args) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.50:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 18:06:49 devstack cinder-volume[83867]: ERROR oslo_messaging.rpc.server Apr 29 18:06:52 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Acquiring lock "singleton_lock" {{(pid=83867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:06:52 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Acquired lock "singleton_lock" {{(pid=83867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:06:52 devstack cinder-volume[83867]: DEBUG oslo_concurrency.lockutils [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Releasing lock "singleton_lock" {{(pid=83867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:06:52 devstack cinder-volume[83867]: WARNING amqp [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:06:52 devstack cinder-volume[83867]: WARNING amqp [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:06:52 devstack cinder-volume[83600]: INFO oslo_service.backend._eventlet.service [None req-be0a0d8a-c4f8-425d-ae71-90ef9edd5cb6 None None] Child 83867 exited with status 0 Apr 29 18:06:56 devstack cinder-volume[84162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:06:56 devstack cinder-volume[84162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:06:56 devstack cinder-volume[84162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:06:57 devstack cinder-volume[84162]: INFO dbcounter [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Registered counter for database cinder Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_db.sqlalchemy.engines [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG dbcounter [-] [84162] Writer thread running {{(pid=84162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:06:57 devstack cinder-volume[84162]: INFO cinder.rpc [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 18:06:57 devstack cinder-volume[84162]: INFO cinder.rpc [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_db.sqlalchemy.engines [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:57 devstack cinder-volume[84162]: INFO cinder.volume.manager [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Determined volume DB was empty at startup. Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG cinder.volume.manager [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84162) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 18:06:57 devstack cinder-volume[84162]: WARNING stevedore.named [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:06:57 devstack cinder-volume[84162]: WARNING castellan.key_manager [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:06:57 devstack cinder-volume[84162]: WARNING cinder.keymgr.conf_key_mgr [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:06:57 devstack cinder-volume[84162]: INFO cinder.volume.manager [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_db.sqlalchemy.engines [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:57 devstack cinder-volume[84162]: INFO oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Starting 1 workers Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Started child 84402 {{(pid=84162) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Full set of CONF: {{(pid=84162) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] ******************************************************************************** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Configuration options gathered from: {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] ================================================================================ {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] allow_availability_zone_fallback = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] allow_compression_on_image_upload = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] allowed_direct_url_schemes = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] api_rate_limit = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] auth_strategy = keystone {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_availability_zone = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_host = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_stats_polling_interval = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backup_api_class = cinder.backup.api.API {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backup_name_template = backup-%s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backup_use_same_host = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backup_use_temp_snapshot = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] chap_password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] chap_username = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84402]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_internal_tenant_project_id = 08503a105820486b859c6cc7f45968dc {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_internal_tenant_user_id = 8267fb722cbb420092dbaa67552e6aa8 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cluster = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] compression_format = gzip {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] compute_api_class = cinder.compute.nova.API {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] config_dir = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] config_source = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] control_exchange = openstack {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] debug = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] default_availability_zone = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] default_group_type = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] default_volume_type = QuobyteHD {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] disk_geometry = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] driver_client_cert = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] driver_client_cert_key = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] driver_data_namespace = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] driver_ssl_cert_path = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] driver_ssl_cert_verify = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] driver_use_ssl = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] enable_new_services = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] enable_unsupported_driver = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] enabled_backends = ['QuobyteHD'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] enforce_multipath_for_image_xfer = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] filter_function = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_api_insecure = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_api_ssl_compression = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_ca_certificates_file = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_catalog_info = image:glance:publicURL {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_num_retries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance_request_timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] goodness_function = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] graceful_shutdown_timeout = 5 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] group_api_class = cinder.group.api.API {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] host = devstack {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_compress_on_upload = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_conversion_address_space_limit = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_conversion_cpu_limit = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_conversion_disable = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_upload_use_cinder_backend = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_upload_use_internal_tenant = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_volume_cache_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_volume_cache_max_count = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] image_volume_cache_max_size_gb = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] init_host_max_objects_retrieval = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] instance_format = [instance: %(uuid)s] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] iscsi_target_flags = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] iscsi_write_cache = on {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] iser_helper = tgtadm {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] iser_ip_address = 192.168.122.50 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] iser_port = 3260 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_color = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_config_append = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_dir = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_file = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_options = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_rotate_interval = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_rotate_interval_type = days {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84402) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] log_rotation_type = none {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] max_age = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] max_logfile_count = 30 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] max_logfile_size_mb = 200 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] max_over_subscription_ratio = 20.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] message_reap_interval = 86400 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] message_ttl = 2592000 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] migration_create_volume_timeout_secs = 300 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] monkey_patch = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] monkey_patch_modules = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] my_ip = 192.168.122.50 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] no_snapshot_gb_quota = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] num_iser_scan_tries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] num_shell_tries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] num_volume_device_scan_tries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] nvmeof_conn_info_version = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] nvmet_ns_id = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] nvmet_port_id = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_max_limit = 1000 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_volume_ext_list = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_volume_listen_port = 8776 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_volume_use_ssl = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] osapi_volume_workers = 2 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] per_volume_size_limit = -1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] periodic_fuzzy_delay = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] periodic_interval = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] public_endpoint = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] publish_errors = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_backup_gigabytes = 1000 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_backups = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_gigabytes = 1000 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_groups = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_snapshots = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] quota_volumes = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] rate_limit_burst = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] rate_limit_except_level = CRITICAL {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] rate_limit_interval = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] reinit_driver_count = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] replication_device = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] report_discard_supported = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] report_interval = 120 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] reservation_clean_interval = 86400 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] reservation_expire = 86400 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] reserved_image_namespaces = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] reserved_percentage = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] rpc_response_timeout = 120 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] run_external_periodic_tasks = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] scst_target_driver = iscsi {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] scst_target_iqn_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_down_time = 720 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] shell_completion = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] snapshot_name_template = snapshot-%s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] split_loggers = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] state_path = /opt/stack/data/cinder {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] storage_availability_zone = nova {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] storage_protocol = iSCSI {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] syslog_log_facility = LOG_USER {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] target_helper = lioadm {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] target_ip_address = 192.168.122.50 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] target_port = 3260 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] target_protocol = iscsi {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] target_secondary_ip_addresses = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] trace_flags = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] transport_url = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] until_refresh = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_chap_auth = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_default_quota_class = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_journal = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_json = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_multipath_for_image_xfer = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_stderr = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] use_syslog = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] verify_glance_signatures = enabled {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_api_class = cinder.volume.api.API {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_backend_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_clear = zero {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_clear_ionice = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_clear_size = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_copy_bps_limit = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_dd_blocksize = 1M {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_name_template = volume-%s {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_service_inithost_offload = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volume_usage_audit_period = month {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] zoning_mode = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_concurrency.disable_process_locking = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.admin_password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.admin_token = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.admin_user = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_port = 35357 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_protocol = https {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84402) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 18:06:57 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_section = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_type = password {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_uri = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.auth_version = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.cache = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 18:06:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Running cmd (subprocess): mount.quobyte {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.identity_uri = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.include_service_catalog = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.insecure = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.interface = public {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_password = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcache_username = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.region_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.service_type = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.backend = dogpile.cache.null {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.backend_argument = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.backend_expiration_time = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.config_prefix = cache.oslo {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.debug_cache_backend = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.enable_retry_client = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.enable_socket_keepalive = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.enforce_fips_mode = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.expiration_time = 600 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.hashclient_retry_attempts = 2 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_dead_retry = 300 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_pool_maxsize = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_sasl_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.proxies = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.redis_db = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.redis_server = localhost:6379 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.retry_attempts = 2 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.retry_delay = 0.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.socket_keepalive_count = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.socket_keepalive_idle = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.socket_keepalive_interval = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.socket_timeout = 1.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.tls_allowed_ciphers = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.tls_cafile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.tls_certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.tls_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.tls_keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cache.username = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] coordination.backend_url = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.asyncio_connection = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.asyncio_slave_connection = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.backend = sqlalchemy {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.connection = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.connection_debug = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.connection_parameters = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.connection_recycle_time = 3600 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.connection_trace = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.db_inc_retry_interval = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.db_max_retries = 20 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.db_max_retry_interval = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.db_retry_interval = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.max_overflow = 50 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.max_pool_size = 5 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.max_retries = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.mysql_wsrep_sync_wait = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.pool_timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.retry_interval = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.slave_connection = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.sqlite_synchronous = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.synchronous_reader = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] database.use_db_reconnect = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.connection_string = messaging:// {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.es_doc_type = notification {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.es_scroll_size = 10000 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.es_scroll_time = 2m {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.filter_error_trace = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.hmac_keys = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.sentinel_service_name = mymaster {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.socket_timeout = 0.1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.trace_requests = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler.trace_sqlalchemy = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler_jaeger.process_tags = {} {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler_jaeger.service_name_prefix = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] profiler_otlp.service_name_prefix = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.enforce_new_defaults = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: WARNING oslo_config.cfg [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.enforce_scope = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.policy_default_rule = default {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.policy_file = policy.yaml {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_policy.remote_timeout = 60.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.group = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.helper_command = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] privsep_osbrick.user = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.group = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.helper_command = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] cinder_sys_admin.user = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.auth_section = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.auth_type = password {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.cafile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.collect_timing = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.insecure = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.send_service_user_token = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.split_loggers = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] service_user.timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.auth_section = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.auth_type = password {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.collect_timing = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.insecure = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.region_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.split_loggers = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] glance.timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.backend_availability_zone = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.chap_password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.chap_username = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.disk_geometry = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.driver_client_cert = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.driver_client_cert_key = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.driver_data_namespace = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.driver_use_ssl = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.extra_capabilities = {} {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.filter_function = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.goodness_function = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:57 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.iscsi_target_flags = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.iscsi_write_cache = on {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.iser_helper = tgtadm {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.iser_port = 3260 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_host = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_login = admin {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_mount_options = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_private_key = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_share_path = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_ssh_port = 22 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.num_shell_tries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.quobyte_volume_url = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.replication_device = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.report_discard_supported = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.reserved_percentage = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.target_helper = tgtadm {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.target_port = 3260 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.target_protocol = iscsi {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.trace_flags = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.unique_fqdn_network = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.use_chap_auth = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_backend_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_clear = zero {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_clear_ionice = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_clear_size = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_reports.file_event_handler = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_reports.log_dir = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.backend_availability_zone = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.backend_host = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.chap_password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.chap_username = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.chiscsi_conf = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.disk_geometry = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.driver_client_cert = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.driver_data_namespace = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.driver_use_ssl = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.extra_capabilities = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.filter_function = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.goodness_function = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.iscsi_target_flags = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.iscsi_write_cache = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.iser_helper = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.iser_ip_address = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.iser_port = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.iser_target_prefix = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_host = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_login = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_mount_options = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_password = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_private_key = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_share_path = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_ssh_port = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.num_shell_tries = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nvmet_ns_id = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.nvmet_port_id = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.replication_device = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.report_discard_supported = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.reserved_percentage = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.scst_target_driver = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.storage_protocol = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.target_helper = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.target_ip_address = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.target_port = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.target_prefix = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.target_protocol = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.trace_flags = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.unique_fqdn_network = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.use_chap_auth = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_clear = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_clear_ionice = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_clear_size = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] QuobyteHD.volumes_dir = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.ssl = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_notifications.driver = [] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_notifications.retry = -1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] key_manager.fixed_key = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.barbican_api_version = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.barbican_endpoint = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.barbican_endpoint_type = public {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.barbican_region_name = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.cafile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.collect_timing = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.insecure = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.number_of_retries = 60 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.retry_delay = 1 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.send_service_user_token = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.split_loggers = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.verify_ssl = True {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican.verify_ssl_path = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.auth_section = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.auth_type = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.cafile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.certfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.collect_timing = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.insecure = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.keyfile = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.split_loggers = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] barbican_service_user.timeout = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.approle_role_id = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.approle_secret_id = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.kv_mountpoint = secret {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.kv_path = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.kv_version = 2 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.namespace = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.root_token_id = **** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.ssl_ca_crt_file = None {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.timeout = 60.0 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.use_ssl = False {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:06:58 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:58 devstack cinder-volume[84162]: DEBUG oslo_service.backend._eventlet.service [None req-81ec076f-b0d8-4ba3-99c7-0c73ed4eb740 None None] ******************************************************************************** {{(pid=84162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.650s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:58 devstack cinder-volume[84402]: INFO cinder.volume.driver [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.volume.driver [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5615272521973, 'free_capacity_gb': 1775.5615272521973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84402) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_db.sqlalchemy.engines [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84402) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writer thread running {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.db.sqlalchemy.api [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Building query based on filter {{(pid=84402) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84402) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:58 devstack cinder-volume[84402]: INFO cinder.keymgr.migration [None req-601fae3c-777f-4120-9947-e7862922c6a4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 18:06:58 devstack sudo[84429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:58 devstack sudo[84429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:59 devstack sudo[84429]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.583s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:06:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Driver initialization completed successfully. Apr 29 18:06:59 devstack cinder-volume[84402]: INFO cinder.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Initiating service 3 cleanup Apr 29 18:06:59 devstack cinder-volume[84402]: INFO cinder.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Service 3 cleanup completed. Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG cinder.service [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Creating RPC server for service cinder-volume {{(pid=84402) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG cinder.service [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84402) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 18:06:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:06:59 devstack sudo[84434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:06:59 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:06:59 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root Apr 29 18:06:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.569s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:06:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-808d2cf3-5650-48b2-8eae-19054dd43ef0 None None] Driver post RPC initialization completed successfully. Apr 29 18:07:07 devstack cinder-volume[84162]: DEBUG dbcounter [-] [84162] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:07:09 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:07:09 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=2 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Flow 'volume_create_manager' (1d7ad6b9-3222-413e-a304-05be74b5621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86672a31-c3b3-4561-a7eb-f807727b4381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86672a31-c3b3-4561-a7eb-f807727b4381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-730383213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fab09fb-e763-49f5-9ce5-6c585dac9747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe90cbf3739435e90d71668950835ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:30Z,use_quota=True,user_id='1957fca4e6a342c7846da41f6082c5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c563ad5-9274-4534-a02f-e4e1b1bf987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c563ad5-9274-4534-a02f-e4e1b1bf987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4fdd1a-4990-49e0-9b08-b3bedcbc3787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4fdd1a-4990-49e0-9b08-b3bedcbc3787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fab09fb-e763-49f5-9ce5-6c585dac9747', 'volume_name': 'volume-6fab09fb-e763-49f5-9ce5-6c585dac9747', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00788cae-dadb-4c76-9572-959e33c87545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00788cae-dadb-4c76-9572-959e33c87545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1cc0c7-cc0e-459a-9a9b-11f2ad248d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Volume 6fab09fb-e763-49f5-9ce5-6c585dac9747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fab09fb-e763-49f5-9ce5-6c585dac9747', 'volume_size': 1} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-730383213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fab09fb-e763-49f5-9ce5-6c585dac9747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe90cbf3739435e90d71668950835ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:30Z,use_quota=True,user_id='1957fca4e6a342c7846da41f6082c5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Creating volume 6fab09fb-e763-49f5-9ce5-6c585dac9747 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:08:30 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:08:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:31 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 1073741824 Apr 29 18:08:31 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:33 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 1073741824" returned: 0 in 2.805s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:33 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 Apr 29 18:08:33 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:35 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747" returned: 0 in 1.413s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] <== create_volume: return (4374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.380s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1cc0c7-cc0e-459a-9a9b-11f2ad248d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fab09fb-e763-49f5-9ce5-6c585dac9747', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c97acff-8111-4138-a544-81f91c1cd80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:35 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Volume volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 (6fab09fb-e763-49f5-9ce5-6c585dac9747): created successfully Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c97acff-8111-4138-a544-81f91c1cd80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Flow 'volume_create_manager' (1d7ad6b9-3222-413e-a304-05be74b5621c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:35 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-babb6bb6-8fac-453c-b150-67604b2b9a82 tempest-VolumesAdminNegativeTest-1277362008 None] Created volume successfully. Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:35 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:08:35 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:36 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:08:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Flow 'volume_create_manager' (43556a72-9932-42c2-b22f-e7dbe4f916cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47d48ee-50a5-4ad4-b2a9-d139d1f04a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47d48ee-50a5-4ad4-b2a9-d139d1f04a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1747155294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59215b81-13eb-4a41-962b-56a59d184b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc647cc08e94e1f8f4b3a2462fa423a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:37Z,use_quota=True,user_id='7cb2dd6940b54588b8b676769d2b1ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd32261-aa6e-48a4-bedb-f734dedb9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd32261-aa6e-48a4-bedb-f734dedb9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d930a1-c08d-4e59-803a-60c441b4524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d930a1-c08d-4e59-803a-60c441b4524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59215b81-13eb-4a41-962b-56a59d184b89', 'volume_name': 'volume-59215b81-13eb-4a41-962b-56a59d184b89', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4922102-d110-47df-8914-ee5b7227fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4922102-d110-47df-8914-ee5b7227fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1834bc-22ca-46ae-a055-f72921ab780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:37 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Volume 59215b81-13eb-4a41-962b-56a59d184b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59215b81-13eb-4a41-962b-56a59d184b89', 'volume_size': 1} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1747155294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59215b81-13eb-4a41-962b-56a59d184b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc647cc08e94e1f8f4b3a2462fa423a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:37Z,use_quota=True,user_id='7cb2dd6940b54588b8b676769d2b1ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Creating volume 59215b81-13eb-4a41-962b-56a59d184b89 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:08:37 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:37 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.621s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:08:37 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 1073741824 Apr 29 18:08:37 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Acquiring lock "cinder-6fab09fb-e763-49f5-9ce5-6c585dac9747-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:08:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Lock "cinder-6fab09fb-e763-49f5-9ce5-6c585dac9747-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:08:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Acquiring lock "cinder-quobyte-6fab09fb-e763-49f5-9ce5-6c585dac9747" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:08:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Lock "cinder-quobyte-6fab09fb-e763-49f5-9ce5-6c585dac9747" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:08:38 devstack cinder-volume[84402]: INFO oslo.privsep.daemon [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyqx57aq0/privsep.sock'] Apr 29 18:08:38 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyqx57aq0/privsep.sock Apr 29 18:08:38 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:39 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 1073741824" returned: 0 in 1.758s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:39 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 Apr 29 18:08:39 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:41 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89" returned: 0 in 2.443s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] <== create_volume: return (4330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.345s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1834bc-22ca-46ae-a055-f72921ab780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59215b81-13eb-4a41-962b-56a59d184b89', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767a3e29-fc63-48eb-929f-e3ed3b1bf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Volume volume-59215b81-13eb-4a41-962b-56a59d184b89 (59215b81-13eb-4a41-962b-56a59d184b89): created successfully Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767a3e29-fc63-48eb-929f-e3ed3b1bf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Flow 'volume_create_manager' (43556a72-9932-42c2-b22f-e7dbe4f916cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-91452670-8adc-4567-9904-fd5200434638 tempest-ServerRescueNegativeTestJSON-457062188 None] Created volume successfully. Apr 29 18:08:41 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:41 devstack cinder-volume[84402]: INFO oslo.privsep.daemon [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Spawned new privsep daemon via rootwrap Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Accepted privsep connection to /tmp/tmpyqx57aq0/privsep.sock {{(pid=84402) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 18:08:41 devstack cinder-volume[84402]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 18:08:41 devstack cinder-volume[84402]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 18:08:41 devstack cinder-volume[84402]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 18:08:41 devstack cinder-volume[84402]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85639 Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af305b0-c5ea-4e8d-93ec-e40e1efee81b]: (2,) {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbabf2ed-f308-4fae-900d-cc716e46f4d8]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:08:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:42 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 Apr 29 18:08:42 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:44 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747" returned: 0 in 2.303s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:44 devstack sudo[85648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747 Apr 29 18:08:44 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:45 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fab09fb-e763-49f5-9ce5-6c585dac9747" returned: 0 in 1.443s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Lock "cinder-quobyte-6fab09fb-e763-49f5-9ce5-6c585dac9747" released by "delete_volume" :: held 7.576s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:08:45 devstack cinder-volume[84402]: WARNING cinder.quota [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:08:45 devstack cinder-volume[84402]: WARNING cinder.quota [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Created reservations ['e586c58d-c84d-4cf9-985f-96564cc402fb', '63149f62-9d14-47ae-9c57-7a286fc9ada9', '099e0870-a14f-4186-b24f-ebbcd560bcdf', 'd6a5b625-a811-4bf1-b5bd-4ca3c15c15e0'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:46 devstack sudo[85651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:08:46 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:47 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.392s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:47 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:08:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Deleted volume successfully. Apr 29 18:08:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-56adb1e2-5be5-4822-8c70-54897a7849cd tempest-VolumesAdminNegativeTest-1277362008 None] Lock "cinder-6fab09fb-e763-49f5-9ce5-6c585dac9747-delete_volume" released by "delete_volume" :: held 9.872s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:08:50 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:08:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Flow 'volume_create_manager' (fee68f5a-26ed-4f0d-b959-789f486bdb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfe379c-72e9-44c9-8048-e1f72c42094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfe379c-72e9-44c9-8048-e1f72c42094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-713873077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fc4320-b6de-433a-9d96-a221eca94bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34c11c7f4404844852cd1ab15926366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:51Z,use_quota=True,user_id='0864be1cf6ce4bfcb9f597038ccaefa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0bbedd-cd68-476b-9284-f617cd5bd113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0bbedd-cd68-476b-9284-f617cd5bd113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68df6618-33de-47b8-a96f-826e7c745889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68df6618-33de-47b8-a96f-826e7c745889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fc4320-b6de-433a-9d96-a221eca94bde', 'volume_name': 'volume-49fc4320-b6de-433a-9d96-a221eca94bde', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fdf655-4d1b-46af-9780-30f68ccb93d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fdf655-4d1b-46af-9780-30f68ccb93d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaae09d7-a4f1-4c63-ae23-927dadb0acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:51 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Volume 49fc4320-b6de-433a-9d96-a221eca94bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fc4320-b6de-433a-9d96-a221eca94bde', 'volume_size': 1} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-713873077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fc4320-b6de-433a-9d96-a221eca94bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34c11c7f4404844852cd1ab15926366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:51Z,use_quota=True,user_id='0864be1cf6ce4bfcb9f597038ccaefa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Creating volume 49fc4320-b6de-433a-9d96-a221eca94bde {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:08:51 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:08:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:51 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde 1073741824 Apr 29 18:08:51 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:52 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde 1073741824" returned: 0 in 1.404s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:52 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde Apr 29 18:08:52 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:08:53 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde" returned: 0 in 1.005s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.461s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaae09d7-a4f1-4c63-ae23-927dadb0acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fc4320-b6de-433a-9d96-a221eca94bde', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3362f46b-0ecd-40d2-b868-be57a667a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:53 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Volume volume-49fc4320-b6de-433a-9d96-a221eca94bde (49fc4320-b6de-433a-9d96-a221eca94bde): created successfully Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3362f46b-0ecd-40d2-b868-be57a667a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Flow 'volume_create_manager' (fee68f5a-26ed-4f0d-b959-789f486bdb1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0e8b6756-9335-4a46-a124-e48f365d6705 tempest-ServersNegativeTestJSON-184797044 None] Created volume successfully. Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Flow 'volume_create_manager' (c2b5a869-593c-4bab-871e-3921dcb449d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60caba1-8cb5-4872-b9df-622b0d46b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60caba1-8cb5-4872-b9df-622b0d46b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1907908834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b85a44e-af8d-4512-8d42-cd220b689ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34c11c7f4404844852cd1ab15926366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:59Z,use_quota=True,user_id='0864be1cf6ce4bfcb9f597038ccaefa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9253eb8-e0aa-47a3-a879-23dd59583c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9253eb8-e0aa-47a3-a879-23dd59583c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082b8f88-cf2f-4fe8-a315-8d99e1aa44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082b8f88-cf2f-4fe8-a315-8d99e1aa44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b85a44e-af8d-4512-8d42-cd220b689ec4', 'volume_name': 'volume-2b85a44e-af8d-4512-8d42-cd220b689ec4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a57c8e-1311-4a2e-8481-35ecea44acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a57c8e-1311-4a2e-8481-35ecea44acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665a8a0d-55b8-41ed-9f86-1fb324600d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:08:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Volume 2b85a44e-af8d-4512-8d42-cd220b689ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b85a44e-af8d-4512-8d42-cd220b689ec4', 'volume_size': 1} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1907908834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b85a44e-af8d-4512-8d42-cd220b689ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34c11c7f4404844852cd1ab15926366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:08:59Z,use_quota=True,user_id='0864be1cf6ce4bfcb9f597038ccaefa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Creating volume 2b85a44e-af8d-4512-8d42-cd220b689ec4 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:08:59 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:08:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:08:59 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 1073741824 Apr 29 18:08:59 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:01 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 1073741824" returned: 0 in 1.669s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:01 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 Apr 29 18:09:01 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:02 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4" returned: 0 in 1.493s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] <== create_volume: return (3307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.321s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665a8a0d-55b8-41ed-9f86-1fb324600d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b85a44e-af8d-4512-8d42-cd220b689ec4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a33c52-d7d8-49d2-a667-643d68f5c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Volume volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 (2b85a44e-af8d-4512-8d42-cd220b689ec4): created successfully Apr 29 18:09:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a33c52-d7d8-49d2-a667-643d68f5c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Flow 'volume_create_manager' (c2b5a869-593c-4bab-871e-3921dcb449d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:03 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d1c5f36d-3963-49d6-b6d9-098b75141ca4 tempest-ServersNegativeTestJSON-184797044 None] Created volume successfully. Apr 29 18:09:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "cinder-2b85a44e-af8d-4512-8d42-cd220b689ec4-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-2b85a44e-af8d-4512-8d42-cd220b689ec4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "cinder-quobyte-2b85a44e-af8d-4512-8d42-cd220b689ec4" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-quobyte-2b85a44e-af8d-4512-8d42-cd220b689ec4" acquired by "delete_volume" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[04627b5b-717a-4f72-a498-f49c9b8d1cf0]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:06 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 Apr 29 18:09:06 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Acquiring lock "cinder-59215b81-13eb-4a41-962b-56a59d184b89-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "cinder-59215b81-13eb-4a41-962b-56a59d184b89-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Acquiring lock "cinder-quobyte-59215b81-13eb-4a41-962b-56a59d184b89" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "cinder-quobyte-59215b81-13eb-4a41-962b-56a59d184b89" acquired by "delete_volume" :: waited 0.042s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd6783-2809-4853-afe5-c2b8bdc33bc8]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:07 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 Apr 29 18:09:07 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:07 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4" returned: 0 in 1.501s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:07 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4 Apr 29 18:09:07 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:08 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89" returned: 0 in 1.343s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:08 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89 Apr 29 18:09:08 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:08 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2b85a44e-af8d-4512-8d42-cd220b689ec4" returned: 0 in 1.425s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-quobyte-2b85a44e-af8d-4512-8d42-cd220b689ec4" released by "delete_volume" :: held 3.017s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Created reservations ['31510ebe-9f98-413b-8bb2-4714c05d5612', '88d64bb5-5f3c-4e6b-a2e5-07d7b42b2b33', 'bd088b48-d582-429e-91b0-eeb446aabd62', 'a5c297e2-d5b3-43e4-9325-1be5fcebd8ce'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:09 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:09 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "cinder-49fc4320-b6de-433a-9d96-a221eca94bde-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-49fc4320-b6de-433a-9d96-a221eca94bde-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "cinder-quobyte-49fc4320-b6de-433a-9d96-a221eca94bde" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-quobyte-49fc4320-b6de-433a-9d96-a221eca94bde" acquired by "delete_volume" :: waited 0.058s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:09 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-59215b81-13eb-4a41-962b-56a59d184b89" returned: 0 in 1.208s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "cinder-quobyte-59215b81-13eb-4a41-962b-56a59d184b89" released by "delete_volume" :: held 2.651s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c3eb15-c730-4a5b-b169-43989fd3cd97]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:09 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde Apr 29 18:09:09 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Created reservations ['cb97b02b-be03-471a-8660-511f925017c2', 'e91f37fe-3383-4d8e-973e-2fb11b9fa7a8', '71996dc9-8cb3-4278-bd63-5dc2f93473fc', '36117efe-c42a-418a-87dd-adf673a58928'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:10 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:10 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:10 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.398s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Deleted volume successfully. Apr 29 18:09:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-08170db4-5052-4818-921a-7b5d2dde12f6 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-2b85a44e-af8d-4512-8d42-cd220b689ec4-delete_volume" released by "delete_volume" :: held 5.056s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:11 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde" returned: 0 in 1.398s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:11 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde Apr 29 18:09:11 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:11 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.503s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:11 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Deleted volume successfully. Apr 29 18:09:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-843953a4-540a-4213-a0d5-7aedf5548b88 tempest-ServerRescueNegativeTestJSON-457062188 None] Lock "cinder-59215b81-13eb-4a41-962b-56a59d184b89-delete_volume" released by "delete_volume" :: held 4.899s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:12 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49fc4320-b6de-433a-9d96-a221eca94bde" returned: 0 in 1.092s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-quobyte-49fc4320-b6de-433a-9d96-a221eca94bde" released by "delete_volume" :: held 2.639s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Created reservations ['ccc33433-198e-4402-b802-dba06eda3a40', 'bc1f6510-1d2d-4e60-ae74-aea167e198e5', 'aacc6ebb-10df-41ce-8bf1-13e331698f36', 'de6701fe-7e03-4b16-8751-15578b160ee9'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:12 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:12 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:14 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.514s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:14 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:14 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Deleted volume successfully. Apr 29 18:09:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-74dabd0e-fce8-48b6-95cc-f669b61fb129 tempest-ServersNegativeTestJSON-184797044 None] Lock "cinder-49fc4320-b6de-433a-9d96-a221eca94bde-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=26,cinder:UPDATE=49,cinder:INSERT=8,cinder:DELETE=6 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Flow 'volume_create_manager' (97b9b50a-7441-4679-a10c-8a0e76b9c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f9b641-c1aa-461a-90db-e232fe124dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f9b641-c1aa-461a-90db-e232fe124dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-93841912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffab74e-eaff-497b-8423-f6dfe309727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec87403d0034be6a178c1500daa4e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:23Z,use_quota=True,user_id='efa1c39656a741ceac5b83543a19f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2384916-15b5-46f7-b543-ae4ac8467866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2384916-15b5-46f7-b543-ae4ac8467866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876a5997-57a4-4b64-aa48-d33ac59e053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876a5997-57a4-4b64-aa48-d33ac59e053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ffab74e-eaff-497b-8423-f6dfe309727b', 'volume_name': 'volume-5ffab74e-eaff-497b-8423-f6dfe309727b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652f05c0-6aa1-428c-9f0e-e5e56d99a066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652f05c0-6aa1-428c-9f0e-e5e56d99a066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76099af-bc62-438e-b6fb-cedefc208db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Volume 5ffab74e-eaff-497b-8423-f6dfe309727b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ffab74e-eaff-497b-8423-f6dfe309727b', 'volume_size': 1} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-93841912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffab74e-eaff-497b-8423-f6dfe309727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec87403d0034be6a178c1500daa4e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:23Z,use_quota=True,user_id='efa1c39656a741ceac5b83543a19f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Creating volume 5ffab74e-eaff-497b-8423-f6dfe309727b {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:09:22 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:09:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:22 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b 1073741824 Apr 29 18:09:22 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:24 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b 1073741824" returned: 0 in 1.220s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:24 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b Apr 29 18:09:24 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:25 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b" returned: 0 in 0.951s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76099af-bc62-438e-b6fb-cedefc208db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ffab74e-eaff-497b-8423-f6dfe309727b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c53072-9a60-424c-9cde-c16ae9128f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:25 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Volume volume-5ffab74e-eaff-497b-8423-f6dfe309727b (5ffab74e-eaff-497b-8423-f6dfe309727b): created successfully Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c53072-9a60-424c-9cde-c16ae9128f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Flow 'volume_create_manager' (97b9b50a-7441-4679-a10c-8a0e76b9c430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:25 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3d4967ae-c254-4d83-bafe-ed8d77a5df84 tempest-DeleteServersTestJSON-1256136195 None] Created volume successfully. Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Flow 'volume_create_manager' (906f1af3-127b-4127-8a61-6538275e3ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a69aed8-5ed5-4665-b885-ca28e377b497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a69aed8-5ed5-4665-b885-ca28e377b497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1141450112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36e719f-351c-4f1b-9903-3fa25170ce58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14009f5434fa449f896c7c1c1836372f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:29Z,use_quota=True,user_id='ade7d5dcc2de4520ac1554aeecdea840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83d1549-3a05-4a91-84cb-4b607687ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83d1549-3a05-4a91-84cb-4b607687ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be7a857-d35c-4faa-a222-53142add191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be7a857-d35c-4faa-a222-53142add191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36e719f-351c-4f1b-9903-3fa25170ce58', 'volume_name': 'volume-a36e719f-351c-4f1b-9903-3fa25170ce58', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dad129-0ab0-4759-8df4-c755474d5268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dad129-0ab0-4759-8df4-c755474d5268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf595f4c-5aef-41e0-a8e4-134a8ea51891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Volume a36e719f-351c-4f1b-9903-3fa25170ce58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36e719f-351c-4f1b-9903-3fa25170ce58', 'volume_size': 1} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1141450112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36e719f-351c-4f1b-9903-3fa25170ce58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14009f5434fa449f896c7c1c1836372f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:29Z,use_quota=True,user_id='ade7d5dcc2de4520ac1554aeecdea840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Creating volume a36e719f-351c-4f1b-9903-3fa25170ce58 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:09:28 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:09:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:28 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 1073741824 Apr 29 18:09:28 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:30 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 1073741824" returned: 0 in 1.220s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:30 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=33,cinder:UPDATE=45,cinder:INSERT=12,cinder:DELETE=3 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:09:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:30 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 Apr 29 18:09:30 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:30 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58" returned: 0 in 0.753s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:31 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf595f4c-5aef-41e0-a8e4-134a8ea51891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36e719f-351c-4f1b-9903-3fa25170ce58', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:31 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a621fa2a-0225-4602-a9ff-302797892e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:31 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Volume volume-a36e719f-351c-4f1b-9903-3fa25170ce58 (a36e719f-351c-4f1b-9903-3fa25170ce58): created successfully Apr 29 18:09:31 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a621fa2a-0225-4602-a9ff-302797892e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:31 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Flow 'volume_create_manager' (906f1af3-127b-4127-8a61-6538275e3ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:31 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-9a70d0e8-8a16-4a10-aea0-e01dadfe559d req-ff1c9d89-aed5-48ed-9c00-6e2a1fa98b0d tempest-VolumesGetTestJSON-1607889149 None] Created volume successfully. Apr 29 18:09:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Acquiring lock "cinder-a36e719f-351c-4f1b-9903-3fa25170ce58-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Lock "cinder-a36e719f-351c-4f1b-9903-3fa25170ce58-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Acquiring lock "cinder-quobyte-a36e719f-351c-4f1b-9903-3fa25170ce58" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Lock "cinder-quobyte-a36e719f-351c-4f1b-9903-3fa25170ce58" acquired by "delete_volume" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:32 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2c8823-2463-4bee-b3d1-570612c28bd4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:33 devstack cinder-volume[84402]: WARNING py.warnings [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 29 18:09:33 devstack cinder-volume[84402]: .first() Apr 29 18:09:33 devstack cinder-volume[84402]: Apr 29 18:09:33 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 Apr 29 18:09:33 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b1c111-26ef-4952-9db9-8b147a533114]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:33 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b Apr 29 18:09:33 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-11c1ed93-7808-4a56-ad46-1671cd05294a tempest-BackendsCapabilitiesAdminTestsJSON-356641992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5615272521973, 'free_capacity_gb': 1775.5615272521973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84402) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 18:09:33 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58" returned: 0 in 0.866s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:33 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58 Apr 29 18:09:33 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:33 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b" returned: 0 in 0.838s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61', 'name': 'volume-5ffab74e-eaff-497b-8423-f6dfe309727b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8f70d11-4544-4af6-a8d1-418bbb60fcb2', 'enforce_multipath': True} {{(pid=84402) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 18:09:34 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-abc0d4f3-c90a-4f16-a756-e06f44e8d105 req-55543558-9f01-4d02-baa8-65d85c6bc7eb tempest-DeleteServersTestJSON-1256136195 None] attachment_update completed successfully. Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49b25751-d97a-4fd9-9310-2723cd6387a3 tempest-BackendsCapabilitiesAdminTestsJSON-356641992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5615272521973, 'free_capacity_gb': 1775.5615272521973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84402) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 18:09:34 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a36e719f-351c-4f1b-9903-3fa25170ce58" returned: 0 in 0.700s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Lock "cinder-quobyte-a36e719f-351c-4f1b-9903-3fa25170ce58" released by "delete_volume" :: held 1.631s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG cinder.quota [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Created reservations ['c6ec3870-6e10-49cc-b478-4c00cc4f8444', '3c934820-fe61-41e0-8eae-df9ce3a24c4a', '15b38c58-0dc8-4c30-a5f5-955940edeb5d', '351143d8-4c1c-4a60-9be1-9790dd313af2'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:34 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:34 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:35 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.764s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG cinder.manager [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:35 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Deleted volume successfully. Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-ab22d474-3c8c-45dd-b088-148ccafa4782 req-1890fdea-2175-40d9-9683-90226de7bdf5 tempest-VolumesGetTestJSON-1607889149 None] Lock "cinder-a36e719f-351c-4f1b-9903-3fa25170ce58-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:35 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:35 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:36 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.673s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Flow 'volume_create_manager' (b0e6a6d7-79ac-4d3b-80f5-71431000a1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4af589-c0d0-47c9-98ba-f5e1a0007c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4af589-c0d0-47c9-98ba-f5e1a0007c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-671318871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9760cf8b-d3a1-47e2-aa1e-279b64b006ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af8da55c384c03a6a7e31e1a91637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:37Z,use_quota=True,user_id='5bdd5c96468d4caa90656ce4ea025e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ca6402-70f2-48a1-ab5b-d0112a900a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ca6402-70f2-48a1-ab5b-d0112a900a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecf95e5-7f13-491c-95d3-e28828e6b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecf95e5-7f13-491c-95d3-e28828e6b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9760cf8b-d3a1-47e2-aa1e-279b64b006ae', 'volume_name': 'volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cb0d35-cfbc-4fa2-a2ba-d91bde71a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cb0d35-cfbc-4fa2-a2ba-d91bde71a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41acd6c-70fd-4cb2-b768-bb11ba61138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:37 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Volume 9760cf8b-d3a1-47e2-aa1e-279b64b006ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae', 'volume_size': 1} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-671318871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9760cf8b-d3a1-47e2-aa1e-279b64b006ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af8da55c384c03a6a7e31e1a91637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:37Z,use_quota=True,user_id='5bdd5c96468d4caa90656ce4ea025e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Creating volume 9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:09:37 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:09:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:37 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae 1073741824 Apr 29 18:09:37 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:38 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae 1073741824" returned: 0 in 0.920s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:38 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae Apr 29 18:09:38 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:39 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" returned: 0 in 0.736s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41acd6c-70fd-4cb2-b768-bb11ba61138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b88132-1bd5-435b-ae18-75c343ba6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:39 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Volume volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae (9760cf8b-d3a1-47e2-aa1e-279b64b006ae): created successfully Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b88132-1bd5-435b-ae18-75c343ba6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Flow 'volume_create_manager' (b0e6a6d7-79ac-4d3b-80f5-71431000a1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:39 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-f8548e8d-d02d-4d35-b84c-194916612322 req-246cb7c0-7c83-4224-a571-80ad1e73e62f tempest-VolumesSnapshotsTestJSON-2022138834 None] Created volume successfully. Apr 29 18:09:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Creating offline snapshot 01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 of volume 9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:09:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[3143e11c-3e0e-4a85-95cd-589548a24c0a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:40 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae Apr 29 18:09:40 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Flow 'volume_create_manager' (8ec9f674-85eb-4215-8b3e-f4c12e6033d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8b219b-4dcb-4681-9add-53cbb7544c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8b219b-4dcb-4681-9add-53cbb7544c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-687523620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66d554-c956-4efb-9e83-9ba6d0527f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6470eb65a4f15b18d1fded0b00149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:41Z,use_quota=True,user_id='a1c9bff0a66c470baac08db43f3af071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:41 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d1e51f-11c7-4bb0-971c-1654df6afe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d1e51f-11c7-4bb0-971c-1654df6afe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da7dbe8-8a6d-469f-b5d4-ca7b180e1c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da7dbe8-8a6d-469f-b5d4-ca7b180e1c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab66d554-c956-4efb-9e83-9ba6d0527f49', 'volume_name': 'volume-ab66d554-c956-4efb-9e83-9ba6d0527f49', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf4bb88-cbed-4fb6-85ad-276faf99701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf4bb88-cbed-4fb6-85ad-276faf99701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3de9bfb-9589-4a6b-b528-c9cfbc2727f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Volume ab66d554-c956-4efb-9e83-9ba6d0527f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab66d554-c956-4efb-9e83-9ba6d0527f49', 'volume_size': 1} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" returned: 0 in 1.294s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:41 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 1G Apr 29 18:09:41 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-80d1c243-8c4d-4e5d-8a83-6a48d6b0e61b tempest-GroupsTest-1968196242 None] Group tempest-Group1-1502847436: creating Apr 29 18:09:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-80d1c243-8c4d-4e5d-8a83-6a48d6b0e61b tempest-GroupsTest-1968196242 None] Group tempest-Group1-1502847436: created successfully Apr 29 18:09:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-80d1c243-8c4d-4e5d-8a83-6a48d6b0e61b tempest-GroupsTest-1968196242 None] Create group completed successfully. Apr 29 18:09:42 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 1G" returned: 0 in 0.792s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:42 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 Apr 29 18:09:42 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:42 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" returned: 0 in 0.708s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:42 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 is being set with open permissions: ugo+rw Apr 29 18:09:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-dd9293b6-7dc5-4647-8e0e-2124d945301d tempest-GroupsTest-1968196242 None] Group tempest-Group2-1844942610: creating Apr 29 18:09:42 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 Apr 29 18:09:42 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-dd9293b6-7dc5-4647-8e0e-2124d945301d tempest-GroupsTest-1968196242 None] Group tempest-Group2-1844942610: created successfully Apr 29 18:09:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-dd9293b6-7dc5-4647-8e0e-2124d945301d tempest-GroupsTest-1968196242 None] Create group completed successfully. Apr 29 18:09:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-e0499fc2-ae38-4eac-a3d8-63a8348834b3 req-e995d578-c42f-4c1f-82dd-709cb22eff05 tempest-DeleteServersTestJSON-1256136195 None] Terminate volume connection completed successfully. Apr 29 18:09:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-e0499fc2-ae38-4eac-a3d8-63a8348834b3 req-e995d578-c42f-4c1f-82dd-709cb22eff05 tempest-DeleteServersTestJSON-1256136195 None] Deleting attachment f8f70d11-4544-4af6-a8d1-418bbb60fcb2. {{(pid=84402) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 18:09:43 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" returned: 0 in 0.596s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:43 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info Apr 29 18:09:43 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:44 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info" returned: 0 in 0.574s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:44 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info is being set with open permissions: ugo+rw Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:44 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info Apr 29 18:09:44 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Flow 'volume_create_manager' (13ff608e-879a-4645-b7c3-6655b7db2137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438319b-7d4a-41fb-941b-9e5692e8ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438319b-7d4a-41fb-941b-9e5692e8ccae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386922840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e6604f6-ff8a-4fa5-9da5-b243309dffc1,host='devstack@QuobyteHD#QuobyteHD',id=d1395346-a118-48c2-b761-8402a39b6da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fb84852a7d45e1901ac9ced69af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:45Z,use_quota=True,user_id='2097908d49a641cf98cc081bbf481247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b36bc3c0-95ac-4013-a569-6c7d18ed435f),volume_type_id=b36bc3c0-95ac-4013-a569-6c7d18ed435f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e508474-6957-4930-8600-4a435f281499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e508474-6957-4930-8600-4a435f281499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7b7632-536e-4859-905c-0f27ae4cbf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7b7632-536e-4859-905c-0f27ae4cbf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1395346-a118-48c2-b761-8402a39b6da7', 'volume_name': 'volume-d1395346-a118-48c2-b761-8402a39b6da7', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcb809a-15a4-46fa-af2e-6ed3b8612999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcb809a-15a4-46fa-af2e-6ed3b8612999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770c82ce-7dcc-4e7f-8b35-9712f0da0919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:44 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Volume d1395346-a118-48c2-b761-8402a39b6da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1395346-a118-48c2-b761-8402a39b6da7', 'volume_size': 1} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:44 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.info" returned: 0 in 0.610s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.676s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.350s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-687523620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66d554-c956-4efb-9e83-9ba6d0527f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6470eb65a4f15b18d1fded0b00149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:41Z,use_quota=True,user_id='a1c9bff0a66c470baac08db43f3af071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Creating volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:09:44 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:09:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:44 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 1073741824 Apr 29 18:09:44 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-cab12535-8d71-45c8-a1e7-4e6ff155dabb req-21c7cda6-11ba-4cae-a922-1d5075dad2bb tempest-VolumesSnapshotsTestJSON-2022138834 None] Create snapshot completed successfully Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "cinder-01ef65da-3f3b-44c3-a6f4-b055e0dca2f3-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-01ef65da-3f3b-44c3-a6f4-b055e0dca2f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "cinder-quobyte-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-quobyte-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "cinder-quobyte-01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-quobyte-01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Deleting offline snapshot 01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 of volume 9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] snapshot_file for this snap is: volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[77850fcc-b3a5-4264-adb0-51a49ca6b82e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:45 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 Apr 29 18:09:45 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:45 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 1073741824" returned: 0 in 0.827s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:45 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 Apr 29 18:09:45 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:46 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" returned: 0 in 0.732s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0fcc03-4910-49f1-8864-71952bf6beb9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:46 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49" returned: 0 in 0.631s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e6604f6-ff8a-4fa5-9da5-b243309dffc1,created_at=2026-04-29T16:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386922840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e6604f6-ff8a-4fa5-9da5-b243309dffc1,host='devstack@QuobyteHD#QuobyteHD',id=d1395346-a118-48c2-b761-8402a39b6da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fb84852a7d45e1901ac9ced69af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:45Z,use_quota=True,user_id='2097908d49a641cf98cc081bbf481247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b36bc3c0-95ac-4013-a569-6c7d18ed435f),volume_type_id=b36bc3c0-95ac-4013-a569-6c7d18ed435f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Creating volume d1395346-a118-48c2-b761-8402a39b6da7 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:09:46 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:46 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae Apr 29 18:09:46 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3de9bfb-9589-4a6b-b528-c9cfbc2727f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab66d554-c956-4efb-9e83-9ba6d0527f49', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:46 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 1073741824 Apr 29 18:09:46 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5782e05f-b966-4ebd-8581-949ac67234d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Volume volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 (ab66d554-c956-4efb-9e83-9ba6d0527f49): created successfully Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5782e05f-b966-4ebd-8581-949ac67234d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Flow 'volume_create_manager' (8ec9f674-85eb-4215-8b3e-f4c12e6033d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-df408ffd-4ef3-40f9-92cc-36c53c8b0c46 tempest-SnapshotsActionsTest-631740165 None] Created volume successfully. Apr 29 18:09:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:47 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" returned: 0 in 0.767s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:47 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 Apr 29 18:09:47 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:47 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 1073741824" returned: 0 in 0.878s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:47 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 Apr 29 18:09:47 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Acquiring lock "cinder-5ffab74e-eaff-497b-8423-f6dfe309727b-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Lock "cinder-5ffab74e-eaff-497b-8423-f6dfe309727b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Acquiring lock "cinder-quobyte-5ffab74e-eaff-497b-8423-f6dfe309727b" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Lock "cinder-quobyte-5ffab74e-eaff-497b-8423-f6dfe309727b" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e2144a-4553-4697-95a7-7e29aabb8ace]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:47 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b Apr 29 18:09:47 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:47 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" returned: 0 in 0.716s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:47 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3 Apr 29 18:09:47 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:47 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7" returned: 0 in 0.635s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.921s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770c82ce-7dcc-4e7f-8b35-9712f0da0919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1395346-a118-48c2-b761-8402a39b6da7', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3686b81a-a396-4e76-bdc7-78fe42177679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Creating offline snapshot 53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:09:47 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Volume volume-d1395346-a118-48c2-b761-8402a39b6da7 (d1395346-a118-48c2-b761-8402a39b6da7): created successfully Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3686b81a-a396-4e76-bdc7-78fe42177679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Flow 'volume_create_manager' (13ff608e-879a-4645-b7c3-6655b7db2137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2649e574-f95d-424c-97b8-c50646040818]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-71015302-a1f7-49b3-9752-17bed2eaffae tempest-GroupsTest-1968196242 None] Created volume successfully. Apr 29 18:09:48 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 Apr 29 18:09:48 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:48 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b" returned: 0 in 0.736s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:48 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b Apr 29 18:09:48 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:48 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae.01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" returned: 0 in 0.683s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-quobyte-01ef65da-3f3b-44c3-a6f4-b055e0dca2f3" released by "_delete_snapshot" :: held 3.049s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-quobyte-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" released by "delete_snapshot" :: held 3.075s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:48 devstack cinder-volume[84402]: WARNING cinder.quota [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.quota [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Created reservations ['5b4ea633-6f92-480e-ac11-fdf73ab32122', '270b57c0-7edf-469c-9a9a-f4eb7893d53a', 'd3b96005-d512-4da4-8d12-445037a3963b', '56a0a73e-12a9-4ddc-8df0-c5bcf6aba1c6'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Acquiring lock "cinder-quobyte-d1395346-a118-48c2-b761-8402a39b6da7" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:48 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Delete snapshot completed successfully. Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Lock "cinder-quobyte-d1395346-a118-48c2-b761-8402a39b6da7" acquired by "delete_volume" :: waited 0.056s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-0a68c252-6747-4629-a851-a1e6ddc1274f req-ff6f37c1-2e8d-4812-a3b8-77e555117bc3 tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-01ef65da-3f3b-44c3-a6f4-b055e0dca2f3-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[127025da-020b-4438-bce1-f774824f1ed6]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:48 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49" returned: 0 in 0.814s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:48 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 1G Apr 29 18:09:48 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "cinder-9760cf8b-d3a1-47e2-aa1e-279b64b006ae-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-9760cf8b-d3a1-47e2-aa1e-279b64b006ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "cinder-quobyte-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-quobyte-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:09:48 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 Apr 29 18:09:48 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:48 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5ffab74e-eaff-497b-8423-f6dfe309727b" returned: 0 in 0.799s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Lock "cinder-quobyte-5ffab74e-eaff-497b-8423-f6dfe309727b" released by "delete_volume" :: held 1.575s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fde483-a17a-476e-a24e-80acb676760c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Created reservations ['6632775b-b13d-451c-baff-d6f07000c0a2', 'da322b8a-1181-4977-9765-6db2cb1cab21', '521373fc-08ef-41ae-9e6b-5e56e74195d1', '1ceb4b1f-58cb-4445-814b-678e9d34dc2c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:49 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae Apr 29 18:09:49 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:49 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:49 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:49 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7" returned: 0 in 0.855s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:49 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7 Apr 29 18:09:49 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:49 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 1G" returned: 0 in 0.964s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:49 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:09:49 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:49 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.668s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:49 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Deleted volume successfully. Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" returned: 0 in 0.901s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1700410f-b778-4d97-a8e2-bff2fe1552b3 tempest-DeleteServersTestJSON-1256136195 None] Lock "cinder-5ffab74e-eaff-497b-8423-f6dfe309727b-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:49 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae Apr 29 18:09:49 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:50 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d1395346-a118-48c2-b761-8402a39b6da7" returned: 0 in 0.666s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Lock "cinder-quobyte-d1395346-a118-48c2-b761-8402a39b6da7" released by "delete_volume" :: held 1.578s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Created reservations ['86adebe7-2b32-4cba-86f1-ae7bd11ec696'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:50 devstack cinder-volume[84402]: WARNING cinder.quota [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1745598342 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1745598342, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:09:50 devstack cinder-volume[84402]: WARNING cinder.quota [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1745598342 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1745598342, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Created reservations ['b9f5b0c2-31d6-4654-b762-7999d9d95672', '8e83094d-2cc6-4300-8a23-c7e75f5df8e9', '7d1d6cbb-6aef-4e64-b988-e9c112b8c8fa', '8333237a-76f5-4edd-8b14-e788af3442c9'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:50 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.850s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:50 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 is being set with open permissions: ugo+rw Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:50 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:09:50 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:50 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:50 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:50 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" returned: 0 in 0.839s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-quobyte-9760cf8b-d3a1-47e2-aa1e-279b64b006ae" released by "delete_volume" :: held 1.824s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.quota [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Created reservations ['f0ec4673-260a-43c9-9a34-eba78acedb2e', '203a8f04-dd23-48ab-bf19-a54377c845dd', '01aad8fc-b9c2-420f-bdea-28e6e8863e55', '01d701df-5541-46c2-a580-1e31ae081670'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:50 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:50 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Created reservations ['75c44b88-ccd2-44e4-9fab-7d3226fe22c2'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:51 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.673s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:51 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:09:51 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:51 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0bf24351-10cb-4bbd-a195-8a44c861769c tempest-GroupsTest-1968196242 None] Delete group completed successfully. Apr 29 18:09:51 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 1.010s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:51 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info Apr 29 18:09:51 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:51 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.700s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:51 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:51 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f038d2ec-2387-422c-818f-36d41a059792 tempest-GroupsTest-1968196242 None] Delete group completed successfully. Apr 29 18:09:52 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.123s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:52 devstack cinder-volume[84402]: DEBUG cinder.manager [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:09:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Deleted volume successfully. Apr 29 18:09:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91f84a88-d755-4da7-885a-251082147f2b req-0899f8c3-4f64-467e-8146-fff795b19dff tempest-VolumesSnapshotsTestJSON-2022138834 None] Lock "cinder-9760cf8b-d3a1-47e2-aa1e-279b64b006ae-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:09:52 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info" returned: 0 in 0.835s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:52 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info is being set with open permissions: ugo+rw Apr 29 18:09:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:52 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info Apr 29 18:09:52 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fbb79b0c-108d-4463-8044-e6e41c5ee771 tempest-GroupsTest-1968196242 None] Group tempest-GroupsTest-Group-1820426239: creating Apr 29 18:09:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fbb79b0c-108d-4463-8044-e6e41c5ee771 tempest-GroupsTest-1968196242 None] Group tempest-GroupsTest-Group-1820426239: created successfully Apr 29 18:09:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fbb79b0c-108d-4463-8044-e6e41c5ee771 tempest-GroupsTest-1968196242 None] Create group completed successfully. Apr 29 18:09:53 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.info" returned: 0 in 0.926s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.556s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0a29bcbd-8189-42f5-b551-1e97ab1e4f99 tempest-SnapshotsActionsTest-631740165 None] Create snapshot completed successfully Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Flow 'volume_create_manager' (f458e31d-c2fd-471b-a136-82f22c187091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc416efe-4bc5-4fe9-912c-45d00ebb3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc416efe-4bc5-4fe9-912c-45d00ebb3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-272169851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbdeb5fd-5ebc-441d-b10e-acd9732713ad,host='devstack@QuobyteHD#QuobyteHD',id=7bc72460-9310-44b1-9776-941113767766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fb84852a7d45e1901ac9ced69af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:55Z,use_quota=True,user_id='2097908d49a641cf98cc081bbf481247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3129f9ad-a527-4305-9961-f2587fe1a197),volume_type_id=3129f9ad-a527-4305-9961-f2587fe1a197)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18177f79-3580-4fc3-b73a-2e656beb7f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18177f79-3580-4fc3-b73a-2e656beb7f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27df25ad-256e-4d64-9ac7-0112d1c575c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27df25ad-256e-4d64-9ac7-0112d1c575c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc72460-9310-44b1-9776-941113767766', 'volume_name': 'volume-7bc72460-9310-44b1-9776-941113767766', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fa1682-16f7-45e7-81df-d9241f2c7ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fa1682-16f7-45e7-81df-d9241f2c7ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2762aae-3fd1-4223-836f-b563c7e77d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:54 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Volume 7bc72460-9310-44b1-9776-941113767766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc72460-9310-44b1-9776-941113767766', 'volume_size': 1} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbdeb5fd-5ebc-441d-b10e-acd9732713ad,created_at=2026-04-29T16:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-272169851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbdeb5fd-5ebc-441d-b10e-acd9732713ad,host='devstack@QuobyteHD#QuobyteHD',id=7bc72460-9310-44b1-9776-941113767766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fb84852a7d45e1901ac9ced69af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:55Z,use_quota=True,user_id='2097908d49a641cf98cc081bbf481247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3129f9ad-a527-4305-9961-f2587fe1a197),volume_type_id=3129f9ad-a527-4305-9961-f2587fe1a197)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Creating volume 7bc72460-9310-44b1-9776-941113767766 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:09:54 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:09:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:54 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 1073741824 Apr 29 18:09:54 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:55 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 1073741824" returned: 0 in 1.016s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:55 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 Apr 29 18:09:55 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:56 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.287s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2762aae-3fd1-4223-836f-b563c7e77d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc72460-9310-44b1-9776-941113767766', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fea3095-2491-4bc7-aba9-9fcb167d1426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Creating offline snapshot ffe328ab-eb66-4644-84e9-5409c6be0e00 of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:09:56 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Volume volume-7bc72460-9310-44b1-9776-941113767766 (7bc72460-9310-44b1-9776-941113767766): created successfully Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fea3095-2491-4bc7-aba9-9fcb167d1426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Flow 'volume_create_manager' (f458e31d-c2fd-471b-a136-82f22c187091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f1cbd-a7e8-4986-97a7-f2a5ef0d4b3f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:09:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:56 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-da53c01b-6389-4f45-8471-a534d0b25ddc tempest-GroupsTest-1968196242 None] Created volume successfully. Apr 29 18:09:56 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:09:56 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:09:57 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Flow 'volume_create_manager' (6e2c3573-b85e-4c1a-a1d5-9eb0529dea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942d5c70-a17e-44f7-86c5-c9c6a7de092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 1.018s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942d5c70-a17e-44f7-86c5-c9c6a7de092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712437808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbdeb5fd-5ebc-441d-b10e-acd9732713ad,host='devstack@QuobyteHD#QuobyteHD',id=e0bca484-aec6-4900-a008-734ce2c9504f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fb84852a7d45e1901ac9ced69af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:57Z,use_quota=True,user_id='2097908d49a641cf98cc081bbf481247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3129f9ad-a527-4305-9961-f2587fe1a197),volume_type_id=3129f9ad-a527-4305-9961-f2587fe1a197)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0d97dc-b2e5-40fb-9ed3-3a7a381f02c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:57 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 1G Apr 29 18:09:57 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0d97dc-b2e5-40fb-9ed3-3a7a381f02c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69efc42e-bf38-4721-8b45-ca1199655bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69efc42e-bf38-4721-8b45-ca1199655bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bca484-aec6-4900-a008-734ce2c9504f', 'volume_name': 'volume-e0bca484-aec6-4900-a008-734ce2c9504f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfcda35-f25b-4295-b057-0ffe6a139a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfcda35-f25b-4295-b057-0ffe6a139a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee4cc61-556a-4228-a94b-48c7bd0ee08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:09:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Volume e0bca484-aec6-4900-a008-734ce2c9504f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bca484-aec6-4900-a008-734ce2c9504f', 'volume_size': 1} Apr 29 18:09:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:09:58 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 1G" returned: 0 in 0.939s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:58 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 Apr 29 18:09:58 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:59 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00" returned: 0 in 0.750s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:09:59 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 is being set with open permissions: ugo+rw Apr 29 18:09:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:09:59 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 Apr 29 18:09:59 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:09:59 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 29 18:09:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00" returned: 0 in 0.669s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbdeb5fd-5ebc-441d-b10e-acd9732713ad,created_at=2026-04-29T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712437808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbdeb5fd-5ebc-441d-b10e-acd9732713ad,host='devstack@QuobyteHD#QuobyteHD',id=e0bca484-aec6-4900-a008-734ce2c9504f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fb84852a7d45e1901ac9ced69af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:09:57Z,use_quota=True,user_id='2097908d49a641cf98cc081bbf481247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3129f9ad-a527-4305-9961-f2587fe1a197),volume_type_id=3129f9ad-a527-4305-9961-f2587fe1a197)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Creating volume e0bca484-aec6-4900-a008-734ce2c9504f {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:10:00 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:00 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f 1073741824 Apr 29 18:10:00 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:00 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7ea9325f-69b4-4979-8938-b607c611d3be tempest-SnapshotsActionsTest-631740165 None] Create snapshot completed successfully Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-ffe328ab-eb66-4644-84e9-5409c6be0e00-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-ffe328ab-eb66-4644-84e9-5409c6be0e00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-ffe328ab-eb66-4644-84e9-5409c6be0e00" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ffe328ab-eb66-4644-84e9-5409c6be0e00" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Deleting offline snapshot ffe328ab-eb66-4644-84e9-5409c6be0e00 of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] snapshot_file for this snap is: volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec7e84-a5df-4af2-920c-38d06587b75a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:00 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 Apr 29 18:10:00 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:01 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f 1073741824" returned: 0 in 1.001s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:01 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f Apr 29 18:10:01 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:01 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00" returned: 0 in 0.997s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c3f8da-93a3-43fa-b76b-b99a34bc0dbb]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:01 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:01 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:01 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f" returned: 0 in 0.921s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:10:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee4cc61-556a-4228-a94b-48c7bd0ee08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bca484-aec6-4900-a008-734ce2c9504f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ac7a21-97a5-4f92-9789-c9807f1fab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Volume volume-e0bca484-aec6-4900-a008-734ce2c9504f (e0bca484-aec6-4900-a008-734ce2c9504f): created successfully Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ac7a21-97a5-4f92-9789-c9807f1fab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Flow 'volume_create_manager' (6e2c3573-b85e-4c1a-a1d5-9eb0529dea0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-18c2b854-41d6-4c57-9729-2117cd9a246e tempest-GroupsTest-1968196242 None] Created volume successfully. Apr 29 18:10:02 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.852s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:02 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 Apr 29 18:10:02 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:03 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f34d7291-6297-4ad0-8506-990c4d6a095f tempest-GroupsTest-1968196242 None] Update group completed successfully. Apr 29 18:10:03 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00" returned: 0 in 0.910s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:03 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00 Apr 29 18:10:03 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:04 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.ffe328ab-eb66-4644-84e9-5409c6be0e00" returned: 0 in 0.692s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ffe328ab-eb66-4644-84e9-5409c6be0e00" released by "_delete_snapshot" :: held 3.625s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" released by "delete_snapshot" :: held 3.655s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:04 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Created reservations ['bab215e1-f234-4ca3-ac1d-aa3976befcee', '100fff8c-ead1-41ad-bd14-9a77a21e865f', 'e48b5fb6-d8e8-4897-affd-545d53dffb5d', '7a025d5c-2974-4af7-add3-a804cf48b6e6'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Delete snapshot completed successfully. Apr 29 18:10:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9c09e5ad-261a-4725-9e5e-6058874540c4 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-ffe328ab-eb66-4644-84e9-5409c6be0e00-delete_snapshot" released by "delete_snapshot" :: held 3.814s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ea3d1bca-251d-499e-91fd-f4e93eb0e398 tempest-GroupsTest-1968196242 None] Update group completed successfully. Apr 29 18:10:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Creating offline snapshot f0c98b3a-004c-451c-910a-af000a67e90d of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:10:05 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b101cd0d-b1a8-4e40-a6d8-a427793652b9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:05 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:05 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:06 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.753s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:06 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d 1G Apr 29 18:10:06 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Acquiring lock "cinder-quobyte-7bc72460-9310-44b1-9776-941113767766" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Lock "cinder-quobyte-7bc72460-9310-44b1-9776-941113767766" acquired by "delete_volume" :: waited 0.022s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[55770e58-f652-43fc-b20a-430bf5b993e9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:06 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 Apr 29 18:10:06 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:07 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d 1G" returned: 0 in 1.179s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:07 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d Apr 29 18:10:07 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:07 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766" returned: 0 in 1.136s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:07 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766 Apr 29 18:10:07 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:08 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d" returned: 0 in 0.906s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:08 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d is being set with open permissions: ugo+rw Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:08 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d Apr 29 18:10:08 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:08 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7bc72460-9310-44b1-9776-941113767766" returned: 0 in 0.857s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Lock "cinder-quobyte-7bc72460-9310-44b1-9776-941113767766" released by "delete_volume" :: held 2.038s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Acquiring lock "cinder-quobyte-e0bca484-aec6-4900-a008-734ce2c9504f" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Lock "cinder-quobyte-e0bca484-aec6-4900-a008-734ce2c9504f" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a623b7-ec04-44b8-af03-0200f5575a6e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:08 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f Apr 29 18:10:08 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:08 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d" returned: 0 in 0.692s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.639s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:09 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a608f587-7d00-4fad-a524-ac36a618f917 tempest-SnapshotsActionsTest-631740165 None] Create snapshot completed successfully Apr 29 18:10:09 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f" returned: 0 in 0.753s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:09 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f Apr 29 18:10:09 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-f0c98b3a-004c-451c-910a-af000a67e90d-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-f0c98b3a-004c-451c-910a-af000a67e90d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-f0c98b3a-004c-451c-910a-af000a67e90d" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-f0c98b3a-004c-451c-910a-af000a67e90d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Deleting offline snapshot f0c98b3a-004c-451c-910a-af000a67e90d of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] snapshot_file for this snap is: volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12bd37b-fc82-401b-9d03-317e77a4aee2]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:10 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d Apr 29 18:10:10 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:10 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e0bca484-aec6-4900-a008-734ce2c9504f" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Lock "cinder-quobyte-e0bca484-aec6-4900-a008-734ce2c9504f" released by "delete_volume" :: held 1.550s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Created reservations ['9d63d4db-5cb4-4f05-ba4f-602a73053f5b'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:10 devstack cinder-volume[84402]: WARNING cinder.quota [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1111888897 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1111888897, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:10:10 devstack cinder-volume[84402]: WARNING cinder.quota [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1111888897 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1111888897, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Created reservations ['45a3a04e-2adb-4e1c-b218-01173473d5ba', 'a1092b2c-addb-49e4-87e2-93e4d252e773', '4f320a49-68be-4434-b031-584cf720427e', 'aff8a329-c37e-4fbd-9d22-762bfec8b785'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Created reservations ['599a6bd3-b010-4b0b-a89f-91304ad3f638', '20ccf081-5dfe-4256-a440-00c818d02384', '6a23eb0c-7d67-41c1-a1fc-e8d4d7f24354', '26c05824-5816-43cc-8c0e-a501077683cd'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:10 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:10 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:10 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d" returned: 0 in 0.890s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a406fa0-8d7d-46e2-9987-562c910df098]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:10 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:10 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:11 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.827s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:11 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-94da92c9-c0af-4f5c-9f4b-62369818d556 tempest-GroupsTest-1968196242 None] Delete group completed successfully. Apr 29 18:10:11 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.845s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:11 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:11 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d Apr 29 18:10:11 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:12 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d" returned: 0 in 1.130s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:12 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d Apr 29 18:10:12 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:13 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.f0c98b3a-004c-451c-910a-af000a67e90d" returned: 0 in 0.755s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-f0c98b3a-004c-451c-910a-af000a67e90d" released by "_delete_snapshot" :: held 3.784s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" released by "delete_snapshot" :: held 3.833s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:13 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Created reservations ['617d8046-560c-4962-aadb-3e5be95ca403', 'd44edda5-be1f-4bb7-bc59-328769d62e0b', '2ffd8b00-4324-47ad-9bb7-407dcd055a13', 'd4273f5d-b021-4830-b1a9-cb79c79c830a'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:13 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Delete snapshot completed successfully. Apr 29 18:10:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e752a666-04de-482c-bdcc-a63352734589 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-f0c98b3a-004c-451c-910a-af000a67e90d-delete_snapshot" released by "delete_snapshot" :: held 4.027s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Creating offline snapshot 181ee1ce-881c-4246-a9ba-4042cb464c2d of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:10:14 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[222f7496-84d7-4979-a7a9-d49ff718b227]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:14 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:14 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:15 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.819s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:15 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d 1G Apr 29 18:10:15 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:16 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d 1G" returned: 0 in 0.947s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:16 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d Apr 29 18:10:16 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:16 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d" returned: 0 in 0.677s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:16 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d is being set with open permissions: ugo+rw Apr 29 18:10:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:16 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d Apr 29 18:10:16 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-afb2b2ed-cc15-47b6-95ea-064f6c33ca34 tempest-GroupsV314Test-2136025904 None] Group tempest-GroupsV314Test-Group-974459205: creating Apr 29 18:10:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-afb2b2ed-cc15-47b6-95ea-064f6c33ca34 tempest-GroupsV314Test-2136025904 None] Group tempest-GroupsV314Test-Group-974459205: created successfully Apr 29 18:10:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-afb2b2ed-cc15-47b6-95ea-064f6c33ca34 tempest-GroupsV314Test-2136025904 None] Create group completed successfully. Apr 29 18:10:17 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d" returned: 0 in 0.777s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a54a04d3-e20a-4c69-80d7-f0aef0aeb071 tempest-SnapshotsActionsTest-631740165 None] Create snapshot completed successfully Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-181ee1ce-881c-4246-a9ba-4042cb464c2d-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-181ee1ce-881c-4246-a9ba-4042cb464c2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-181ee1ce-881c-4246-a9ba-4042cb464c2d" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-181ee1ce-881c-4246-a9ba-4042cb464c2d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Deleting offline snapshot 181ee1ce-881c-4246-a9ba-4042cb464c2d of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] snapshot_file for this snap is: volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[334d96db-2585-4780-8881-567eac9a3a2f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:19 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d Apr 29 18:10:19 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Flow 'volume_create_manager' (cfb6438c-934a-4191-9daf-2a59e138b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986fc781-43a0-469a-a7c5-d7ac98cfecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986fc781-43a0-469a-a7c5-d7ac98cfecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-219563868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36a46863-4396-4fbe-8971-c308d567ebf9,host='devstack@QuobyteHD#QuobyteHD',id=55032f4d-abbc-40c6-8d61-207423bb9876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7219f170d240c3aaeacac140d16cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:19Z,use_quota=True,user_id='7642b45cbe114037b5692341c06ab3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(007a71d2-9393-4283-9b98-c192f9fc5f65),volume_type_id=007a71d2-9393-4283-9b98-c192f9fc5f65)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc203df-10a8-45ec-9e59-10c3a5ee9de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc203df-10a8-45ec-9e59-10c3a5ee9de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33532ba-e091-401e-9dd9-b65ee48d756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33532ba-e091-401e-9dd9-b65ee48d756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55032f4d-abbc-40c6-8d61-207423bb9876', 'volume_name': 'volume-55032f4d-abbc-40c6-8d61-207423bb9876', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90674aa6-b036-4dee-8cae-3679153fc981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90674aa6-b036-4dee-8cae-3679153fc981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a33eed5-dab2-4571-b46d-db4d4b7d90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:19 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Volume 55032f4d-abbc-40c6-8d61-207423bb9876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55032f4d-abbc-40c6-8d61-207423bb9876', 'volume_size': 1} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36a46863-4396-4fbe-8971-c308d567ebf9,created_at=2026-04-29T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-219563868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36a46863-4396-4fbe-8971-c308d567ebf9,host='devstack@QuobyteHD#QuobyteHD',id=55032f4d-abbc-40c6-8d61-207423bb9876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7219f170d240c3aaeacac140d16cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:19Z,use_quota=True,user_id='7642b45cbe114037b5692341c06ab3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(007a71d2-9393-4283-9b98-c192f9fc5f65),volume_type_id=007a71d2-9393-4283-9b98-c192f9fc5f65)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Creating volume 55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:10:19 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:10:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:19 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 1073741824 Apr 29 18:10:19 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:20 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d" returned: 0 in 1.175s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35a92c-3644-47b8-bf27-d7d59e27cffb]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Flow 'volume_create_manager' (37d81676-9dd2-472c-94a8-fa78d4eeb6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac3e8a2-b8fa-4130-ab49-3f0ac2b9d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac3e8a2-b8fa-4130-ab49-3f0ac2b9d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1076291946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8053abbb148a7ba2968cbfcc43e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:20Z,use_quota=True,user_id='b8d0c74880ca4d11ae055b0ee7472276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe142c30-bea5-4329-8d2c-ef47c9d53881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe142c30-bea5-4329-8d2c-ef47c9d53881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c650b0-9b98-45e4-b227-eb4319d5b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c650b0-9b98-45e4-b227-eb4319d5b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1', 'volume_name': 'volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9d3ac6-3835-4329-839c-9558c97310e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:20 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9d3ac6-3835-4329-839c-9558c97310e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:20 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6a39f0-e9bf-4c7b-99a5-06add808d86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:20 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Volume ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1', 'volume_size': 1} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:20 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 1073741824" returned: 0 in 0.943s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:20 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:20 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:20 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.794s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:21 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d Apr 29 18:10:21 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:21 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.614s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1076291946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8053abbb148a7ba2968cbfcc43e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:20Z,use_quota=True,user_id='b8d0c74880ca4d11ae055b0ee7472276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Creating volume ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:10:21 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:21 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 1073741824 Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a33eed5-dab2-4571-b46d-db4d4b7d90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55032f4d-abbc-40c6-8d61-207423bb9876', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:21 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7deed5-f9e8-4023-99ef-b8ac223ea9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:21 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Volume volume-55032f4d-abbc-40c6-8d61-207423bb9876 (55032f4d-abbc-40c6-8d61-207423bb9876): created successfully Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7deed5-f9e8-4023-99ef-b8ac223ea9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Flow 'volume_create_manager' (cfb6438c-934a-4191-9daf-2a59e138b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:21 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-15b543b4-ce63-47f7-83d6-96f00d2f268c tempest-GroupsV314Test-2136025904 None] Created volume successfully. Apr 29 18:10:21 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d" returned: 0 in 0.823s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:21 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d Apr 29 18:10:21 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:22 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 1073741824" returned: 0 in 0.858s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:22 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 Apr 29 18:10:22 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:22 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.181ee1ce-881c-4246-a9ba-4042cb464c2d" returned: 0 in 0.636s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-181ee1ce-881c-4246-a9ba-4042cb464c2d" released by "_delete_snapshot" :: held 3.586s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" released by "delete_snapshot" :: held 3.625s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Created reservations ['2060fed1-5419-4ee3-993c-92272024e5ef', '1e201857-96d6-4d4c-995a-2a509e581bd2', '28a2398c-bc61-4e2c-b2b9-5cb0f88258f7', 'f9a85666-085c-40aa-80a7-1f3c9bcf50f0'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=116,cinder:UPDATE=109,cinder:INSERT=29,cinder:DELETE=9 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:10:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Delete snapshot completed successfully. Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb3fdea-273d-4416-b8d3-53e920dc0810 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-181ee1ce-881c-4246-a9ba-4042cb464c2d-delete_snapshot" released by "delete_snapshot" :: held 3.806s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:22 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1" returned: 0 in 0.747s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6a39f0-e9bf-4c7b-99a5-06add808d86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854d997-46a7-4739-9ff8-1c75c50cec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:22 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Cloning volume 55032f4d-abbc-40c6-8d61-207423bb9876 to volume 2973d4f7-34e0-4eb1-a547-53fe3bf34b4b Apr 29 18:10:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Volume volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 (ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1): created successfully Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854d997-46a7-4739-9ff8-1c75c50cec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Flow 'volume_create_manager' (37d81676-9dd2-472c-94a8-fa78d4eeb6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1e65849c-c470-4d37-8980-d3c0e2a3d335 tempest-VolumeQuotasAdminTestJSON-907000543 None] Created volume successfully. Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Creating offline snapshot 0598b2fb-c02f-40b0-8e46-925207f0bd60 of volume 55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ea68d-b6c5-4024-b9c3-a15d0f2b3a6b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:23 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:23 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "cinder-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "cinder-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "cinder-quobyte-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "cinder-quobyte-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c74eae-ebbe-4c62-9c24-bb4397197c5d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:23 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.764s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:23 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 1G Apr 29 18:10:23 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:23 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 Apr 29 18:10:23 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:24 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1" returned: 0 in 0.914s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:24 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1 Apr 29 18:10:24 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:24 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 1G" returned: 0 in 1.042s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55032f4d-abbc-40c6-8d61-207423bb9876 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:24 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55032f4d-abbc-40c6-8d61-207423bb9876 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 Apr 29 18:10:24 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:25 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1" returned: 0 in 1.131s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "cinder-quobyte-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1" released by "delete_volume" :: held 2.095s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:25 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Created reservations ['0852b22f-9ac6-4a4e-b555-90e225a43a36', 'c6ac346b-216b-4b34-bdce-4fa2b9b08cca', '221adaa8-c6a3-45c4-b264-174cccedcc8e', '9c2c80f6-c842-428d-8922-33f60d509647'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55032f4d-abbc-40c6-8d61-207423bb9876 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60" returned: 0 in 1.010s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:25 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:25 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 Apr 29 18:10:25 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:25 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:25 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:26 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60" returned: 0 in 0.638s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:26 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info Apr 29 18:10:26 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:26 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.725s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:26 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Deleted volume successfully. Apr 29 18:10:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-beb70272-a7ad-44df-99a4-4f9b4f0d15c4 tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "cinder-ac97c117-4d91-46dd-b2b6-0e5ee3dd67f1-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:27 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info" returned: 0 in 0.786s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:27 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:27 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info Apr 29 18:10:27 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Flow 'volume_create_manager' (a6978821-4dd4-4262-8da5-4e543cba41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be725a7-c9a9-4734-b195-c2131421ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be725a7-c9a9-4734-b195-c2131421ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1299973054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1568f3-8d85-49bc-843b-a998f848aa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8053abbb148a7ba2968cbfcc43e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:28Z,use_quota=True,user_id='b8d0c74880ca4d11ae055b0ee7472276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54703082-7856-49ea-bf22-0c63b36bf9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54703082-7856-49ea-bf22-0c63b36bf9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895d264d-0910-41b1-9f23-1153844b680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895d264d-0910-41b1-9f23-1153844b680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1568f3-8d85-49bc-843b-a998f848aa1c', 'volume_name': 'volume-3b1568f3-8d85-49bc-843b-a998f848aa1c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcdd16d-92d2-44c1-8fb4-ca036b73c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcdd16d-92d2-44c1-8fb4-ca036b73c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0855617b-e948-4838-be12-536497c18e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:27 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Volume 3b1568f3-8d85-49bc-843b-a998f848aa1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1568f3-8d85-49bc-843b-a998f848aa1c', 'volume_size': 1} Apr 29 18:10:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:28 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.info" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Acquiring lock "cinder-quobyte-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] snapshot: 0598b2fb-c02f-40b0-8e46-925207f0bd60, volume: 2973d4f7-34e0-4eb1-a547-53fe3bf34b4b, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7bd89b-1386-4891-a513-c5e4d653a4ba]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:28 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 Apr 29 18:10:28 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:28 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60" returned: 0 in 0.813s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55032f4d-abbc-40c6-8d61-207423bb9876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb9b9b7-f503-427d-9485-b74e8b521874]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:29 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:29 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:29 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.733s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:29 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:10:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:29 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b Apr 29 18:10:29 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:35 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:35 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:36 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" returned: 0 in 6.882s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:36 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03d3d84-9e9f-4716-9e3f-d36f96a36130]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:36 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:36 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:36 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.001s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:37 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.920s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:37 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:10:37 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Converted 1024.00 MB image at 148.77 MB/s Apr 29 18:10:37 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:10:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:37 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b Apr 29 18:10:37 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:37 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=129,cinder:SELECT=115,cinder:INSERT=27,cinder:DELETE=7 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:10:37 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:10:38 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" returned: 0 in 0.687s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" released by "_copy_volume_from_snapshot" :: held 10.171s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Acquiring lock "cinder-quobyte-0598b2fb-c02f-40b0-8e46-925207f0bd60" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-0598b2fb-c02f-40b0-8e46-925207f0bd60" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Deleting offline snapshot 0598b2fb-c02f-40b0-8e46-925207f0bd60 of volume 55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] snapshot_file for this snap is: volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d100ea-d0b9-4f1d-81b9-ebaa4f8c5735]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:38 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 Apr 29 18:10:38 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:39 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60" returned: 0 in 0.712s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55032f4d-abbc-40c6-8d61-207423bb9876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab1b85-c5ec-4cee-83be-d68b69cee0b9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:39 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:39 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:39 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.743s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:39 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 Apr 29 18:10:39 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:40 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60" returned: 0 in 0.708s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:40 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60 Apr 29 18:10:40 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:41 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876.0598b2fb-c02f-40b0-8e46-925207f0bd60" returned: 0 in 0.626s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-0598b2fb-c02f-40b0-8e46-925207f0bd60" released by "_delete_snapshot" :: held 2.903s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.268s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.643s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Creating offline snapshot 43532184-e46d-48df-8d05-462c2104b14d of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837d145-4afd-4202-bb4a-d2f826d30170]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2c7aada1-d63b-475a-abe9-920a715f85e2 tempest-GroupsV314Test-2136025904 None] Create group from source-group-36a46863-4396-4fbe-8971-c308d567ebf9 completed successfully. Apr 29 18:10:41 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:41 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:42 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.744s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:42 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d 1G Apr 29 18:10:42 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Acquiring lock "cinder-quobyte-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb1d1ec-51ae-4d88-80a4-1e67c44db24b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:42 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b Apr 29 18:10:42 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:42 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d 1G" returned: 0 in 0.808s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:42 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d Apr 29 18:10:42 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:43 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" returned: 0 in 0.757s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:43 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b Apr 29 18:10:43 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:43 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d" returned: 0 in 0.673s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:43 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d is being set with open permissions: ugo+rw Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:43 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d Apr 29 18:10:43 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:43 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" returned: 0 in 0.613s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-2973d4f7-34e0-4eb1-a547-53fe3bf34b4b" released by "delete_volume" :: held 1.434s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Created reservations ['88b7567b-6a76-43a6-84ab-0f0c28181d6f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:43 devstack cinder-volume[84402]: WARNING cinder.quota [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-601463106 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-601463106, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:10:43 devstack cinder-volume[84402]: WARNING cinder.quota [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-601463106 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-601463106, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Created reservations ['7e1cca3e-d73b-4d4a-b490-5822ff79da9e', '0d617951-f37f-42fb-b021-2a83a4b48933', 'e504f859-1396-4966-ad5b-de99adad5955', 'add8af8f-620d-46a6-8b33-a98c72cc519f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:43 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:43 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:44 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d" returned: 0 in 0.602s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.376s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1299973054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1568f3-8d85-49bc-843b-a998f848aa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8053abbb148a7ba2968cbfcc43e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:28Z,use_quota=True,user_id='b8d0c74880ca4d11ae055b0ee7472276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Creating volume 3b1568f3-8d85-49bc-843b-a998f848aa1c {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:10:44 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:44 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c 1073741824 Apr 29 18:10:44 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-69bc90ed-6660-4cec-b563-8618352fc516 tempest-SnapshotsActionsTest-631740165 None] Create snapshot completed successfully Apr 29 18:10:44 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-01b59a9b-0c42-4589-ae7f-b27d79eaa4de tempest-GroupsV314Test-2136025904 None] Delete group completed successfully. Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Acquiring lock "cinder-quobyte-55032f4d-abbc-40c6-8d61-207423bb9876" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-55032f4d-abbc-40c6-8d61-207423bb9876" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b2b3d-49eb-48b9-b3a4-002c31ad062e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-43532184-e46d-48df-8d05-462c2104b14d-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:44 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:44 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-43532184-e46d-48df-8d05-462c2104b14d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Acquiring lock "cinder-quobyte-43532184-e46d-48df-8d05-462c2104b14d" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-43532184-e46d-48df-8d05-462c2104b14d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Deleting offline snapshot 43532184-e46d-48df-8d05-462c2104b14d of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] snapshot_file for this snap is: volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[084e397c-005b-490a-a4ee-c2721c964073]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:45 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c 1073741824" returned: 0 in 0.953s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:45 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d Apr 29 18:10:45 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:45 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c Apr 29 18:10:45 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:45 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.952s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:45 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876 Apr 29 18:10:45 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:46 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d" returned: 0 in 1.065s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b885fd6-e90d-43fa-b44b-677d07856fe4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:46 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c" returned: 0 in 1.025s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0855617b-e948-4838-be12-536497c18e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1568f3-8d85-49bc-843b-a998f848aa1c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68a5401-d8ef-4f7d-847a-e0518fcf04ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Volume volume-3b1568f3-8d85-49bc-843b-a998f848aa1c (3b1568f3-8d85-49bc-843b-a998f848aa1c): created successfully Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68a5401-d8ef-4f7d-847a-e0518fcf04ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Flow 'volume_create_manager' (a6978821-4dd4-4262-8da5-4e543cba41d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2477cdeb-502f-4a1c-a8a6-486ec354173f tempest-VolumeQuotasAdminTestJSON-907000543 None] Created volume successfully. Apr 29 18:10:46 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:46 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:46 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-55032f4d-abbc-40c6-8d61-207423bb9876" returned: 0 in 0.960s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Lock "cinder-quobyte-55032f4d-abbc-40c6-8d61-207423bb9876" released by "delete_volume" :: held 2.018s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Created reservations ['bb90c219-a052-4a05-a452-122a4be006db'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Created reservations ['3865df12-e3e5-4fb7-b129-b1057373b322', '0aca99a0-56ad-43ae-bf43-a783731dd7da', '2c1e401d-c11f-4e0b-9e4d-d4a9e46f8c7b', '76ece9ff-c7b1-4ad2-99c0-3ff9dc84f144'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:47 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:47 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:47 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 1.241s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:47 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d Apr 29 18:10:47 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0ea14799-2e38-4bbb-a5d3-46c309213959 tempest-VolumeQuotasAdminTestJSON-1225094531 None] Transfer volume completed successfully. Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Flow 'volume_create_manager' (17f854d1-7c3e-4bb9-8a94-8a161dbac21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0906009d-e223-41ad-93cb-a03ad3e69797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0906009d-e223-41ad-93cb-a03ad3e69797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:48Z,deleted=False,deleted_at=None,display_description='',display_name='33d40de9-2a8e-4737-9159-e7dd2da59d52-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d863c227-2e03-46ae-939e-44346057be7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc412a60e07c473bb88e7b788ee645d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:48Z,use_quota=True,user_id='84977bfecb3d450ebddab9550b8e8f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12912a67-ff2c-4042-84e8-8867ef858a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12912a67-ff2c-4042-84e8-8867ef858a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91314423-a1d8-4de1-99b1-d3770cb87f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91314423-a1d8-4de1-99b1-d3770cb87f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd863c227-2e03-46ae-939e-44346057be7e', 'volume_name': 'volume-d863c227-2e03-46ae-939e-44346057be7e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd92068a-6770-493f-9df2-a25287191b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd92068a-6770-493f-9df2-a25287191b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c407c4-16b1-41b1-bde2-f3bd42ddd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Volume d863c227-2e03-46ae-939e-44346057be7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d863c227-2e03-46ae-939e-44346057be7e', 'volume_size': 1} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:48 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:10:48Z,deleted=False,deleted_at=None,display_description='',display_name='33d40de9-2a8e-4737-9159-e7dd2da59d52-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d863c227-2e03-46ae-939e-44346057be7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc412a60e07c473bb88e7b788ee645d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:10:48Z,use_quota=True,user_id='84977bfecb3d450ebddab9550b8e8f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Creating volume d863c227-2e03-46ae-939e-44346057be7e {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:10:48 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.955s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:48 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-dbd7ec03-b8ed-4ee3-9d18-27232c3da1a6 tempest-GroupsV314Test-2136025904 None] Delete group completed successfully. Apr 29 18:10:48 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e 1073741824 Apr 29 18:10:48 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:48 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d" returned: 0 in 0.942s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:48 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d Apr 29 18:10:48 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Acquiring lock "cinder-3b1568f3-8d85-49bc-843b-a998f848aa1c-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Lock "cinder-3b1568f3-8d85-49bc-843b-a998f848aa1c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Acquiring lock "cinder-quobyte-3b1568f3-8d85-49bc-843b-a998f848aa1c" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Lock "cinder-quobyte-3b1568f3-8d85-49bc-843b-a998f848aa1c" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4150505-9969-40a9-8533-47e989abe38c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:49 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c Apr 29 18:10:49 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:49 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e 1073741824" returned: 0 in 1.092s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:49 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e Apr 29 18:10:49 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:49 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.43532184-e46d-48df-8d05-462c2104b14d" returned: 0 in 1.024s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-43532184-e46d-48df-8d05-462c2104b14d" released by "_delete_snapshot" :: held 4.438s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" released by "delete_snapshot" :: held 4.476s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Created reservations ['d0711c16-1f02-4206-bf4f-a5aba342f5d6', '4cdd8bfa-a0d0-4ff9-852c-9ea34505a498', '74fee3b0-8131-49e9-ac2e-0ff09d7fa12f', '382b2dcb-f729-406c-87bb-c633ac3bae89'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Delete snapshot completed successfully. Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-971aedff-a515-4c6c-a5bf-bce0b7770ab8 tempest-SnapshotsActionsTest-1678117016 None] Lock "cinder-43532184-e46d-48df-8d05-462c2104b14d-delete_snapshot" released by "delete_snapshot" :: held 4.733s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:49 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c" returned: 0 in 0.862s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:50 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c Apr 29 18:10:50 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:50 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e" returned: 0 in 0.881s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c407c4-16b1-41b1-bde2-f3bd42ddd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d863c227-2e03-46ae-939e-44346057be7e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6d569c-6de6-4589-a957-908e5a936c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:10:50 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Volume volume-d863c227-2e03-46ae-939e-44346057be7e (d863c227-2e03-46ae-939e-44346057be7e): created successfully Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6d569c-6de6-4589-a957-908e5a936c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Flow 'volume_create_manager' (17f854d1-7c3e-4bb9-8a94-8a161dbac21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:10:50 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-fc56d9ad-8fbf-4c9e-b529-4fca648031f4 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Created volume successfully. Apr 29 18:10:50 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3b1568f3-8d85-49bc-843b-a998f848aa1c" returned: 0 in 0.836s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Lock "cinder-quobyte-3b1568f3-8d85-49bc-843b-a998f848aa1c" released by "delete_volume" :: held 1.747s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "cinder-53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:50 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Created reservations ['09686e04-9409-4ed3-a390-04f7d893e693', 'e76053ad-2eaa-4a7e-9fc5-51610e8298d5', '9291437f-d0e8-482b-9a1f-253bc98e5737', '7aa64682-28a8-4967-91f8-78c37d96fdc4'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" acquired by "delete_snapshot" :: waited 0.043s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "cinder-quobyte-53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-quobyte-53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Deleting offline snapshot 53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 of volume ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] snapshot_file for this snap is: volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2147b1-9de2-4d21-afae-ffe17f6b771a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:51 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:51 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:51 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:51 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf5c1e2-e3e3-4768-9680-4c97de98d5ec]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:51 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e Apr 29 18:10:51 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:52 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.011s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Deleted volume successfully. Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cef7b25b-71bb-4db2-9e1e-6e205e26d6e8 tempest-VolumeQuotasAdminTestJSON-1982781574 None] Lock "cinder-3b1568f3-8d85-49bc-843b-a998f848aa1c-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:52 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 1.194s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab66d554-c956-4efb-9e83-9ba6d0527f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[52daea5e-87d0-4301-9234-8230e8f24a7e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:52 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 Apr 29 18:10:52 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:52 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e" returned: 0 in 0.962s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61', 'name': 'volume-d863c227-2e03-46ae-939e-44346057be7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c81f05-d23b-49fe-a874-6408bdf880de', 'enforce_multipath': True} {{(pid=84402) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 18:10:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-269320c9-3842-4667-9588-70b618094305 req-14d82520-2d36-4c62-bb66-c539fb67fc11 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] attachment_update completed successfully. Apr 29 18:10:53 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49" returned: 0 in 0.939s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:53 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:53 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:54 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.828s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:54 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31 Apr 29 18:10:54 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:54 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49.53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-quobyte-53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31" released by "_delete_snapshot" :: held 3.935s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" released by "delete_snapshot" :: held 3.984s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Created reservations ['da170138-26fe-4d16-8582-068389eb94ea', '94d764c7-a8f2-4e9f-a246-afe6b3dc2ba0', 'ceaf9212-a728-4b85-876d-7b29c6fa4a96', '50a49749-11ae-48dc-93cc-8cd2a8d4a413'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:55 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Delete snapshot completed successfully. Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f5e9c7a-8299-4b21-aa1d-15740306fedd tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-53c2b6e2-4ab9-46dc-a9c1-fe25ef18cb31-delete_snapshot" released by "delete_snapshot" :: held 4.190s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "cinder-ab66d554-c956-4efb-9e83-9ba6d0527f49-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-ab66d554-c956-4efb-9e83-9ba6d0527f49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[073ca5e0-32fb-49d2-8fcc-45202132d18e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:10:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:55 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 Apr 29 18:10:55 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:56 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49" returned: 0 in 0.817s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:56 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49 Apr 29 18:10:56 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:57 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ab66d554-c956-4efb-9e83-9ba6d0527f49" returned: 0 in 0.789s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-quobyte-ab66d554-c956-4efb-9e83-9ba6d0527f49" released by "delete_volume" :: held 1.686s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Created reservations ['5f1aa64e-b7c9-461a-a16d-52bfc22bbddc', '40511542-0e29-4589-9dfa-53335435ebfe', '0c237d55-4120-4c76-a46e-eecd03e6b94f', 'fac4887d-17be-4899-9ffa-32344761ca62'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:10:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:10:57 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:10:57 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:10:58 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 29 18:10:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.801s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:10:58 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:10:58 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Deleted volume successfully. Apr 29 18:10:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-68a289d4-341b-4e44-8f11-f1d2d276db1d tempest-SnapshotsActionsTest-631740165 None] Lock "cinder-ab66d554-c956-4efb-9e83-9ba6d0527f49-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:09 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=58,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=2 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:11:09 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=61,cinder:SELECT=46,cinder:INSERT=13,cinder:DELETE=3 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Flow 'volume_create_manager' (fd5a1562-f710-46be-9ff6-6dfa2b70b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0dd064-e277-40bd-aa46-32b89dca2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0dd064-e277-40bd-aa46-32b89dca2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-537969092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7d21ed-d708-4f7c-a5da-e57eea0e2d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2449e531994294b04d4fb6a8a5b66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:14Z,use_quota=True,user_id='181a3e08a4e14efba247d9838716aecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8722f365-f794-4a11-a218-2763bb71e560),volume_type_id=8722f365-f794-4a11-a218-2763bb71e560)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8602ffae-1c38-49a7-8930-618c9e72f0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8602ffae-1c38-49a7-8930-618c9e72f0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62423021-c148-4f29-b25d-6adc7a4ed081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62423021-c148-4f29-b25d-6adc7a4ed081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d7d21ed-d708-4f7c-a5da-e57eea0e2d18', 'volume_name': 'volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a202889-43b4-4705-9e18-c2140976d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a202889-43b4-4705-9e18-c2140976d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9587e7-971a-4d43-a161-1300216363b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:14 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Volume 9d7d21ed-d708-4f7c-a5da-e57eea0e2d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18', 'volume_size': 1} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-537969092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7d21ed-d708-4f7c-a5da-e57eea0e2d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2449e531994294b04d4fb6a8a5b66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:14Z,use_quota=True,user_id='181a3e08a4e14efba247d9838716aecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8722f365-f794-4a11-a218-2763bb71e560),volume_type_id=8722f365-f794-4a11-a218-2763bb71e560)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Creating volume 9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:11:14 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:11:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:14 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 1073741824 Apr 29 18:11:14 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:15 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 1073741824" returned: 0 in 1.011s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:15 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 Apr 29 18:11:15 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:16 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18" returned: 0 in 1.008s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9587e7-971a-4d43-a161-1300216363b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060d2228-d94e-4fa0-bcb5-cca21e58f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:16 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Volume volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 (9d7d21ed-d708-4f7c-a5da-e57eea0e2d18): created successfully Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060d2228-d94e-4fa0-bcb5-cca21e58f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Flow 'volume_create_manager' (fd5a1562-f710-46be-9ff6-6dfa2b70b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-14be793a-9fb8-4e5b-9210-19b6142248b1 tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Created volume successfully. Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Flow 'volume_create_manager' (dbc63dba-ff5c-44b6-aae2-0540de1fec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36aa9f6e-b450-4283-8852-c335dbe2abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36aa9f6e-b450-4283-8852-c335dbe2abd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-435310228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e6a139-c7c6-4d89-9c55-2420ab31a2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cef4437831c40ddbd1c4778eac907a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:17Z,use_quota=True,user_id='a04ca8698c224b3e9562372f9f6e00d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15bdde5-d739-4cdb-b7d7-61e987865ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15bdde5-d739-4cdb-b7d7-61e987865ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5b377b-f53d-4634-878d-19f0124a82aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5b377b-f53d-4634-878d-19f0124a82aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e6a139-c7c6-4d89-9c55-2420ab31a2f6', 'volume_name': 'volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f62896-cfb4-4a56-a3a1-d184710049ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f62896-cfb4-4a56-a3a1-d184710049ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65feaa9a-2d21-47af-8ea7-3c4a8009ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:17 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Volume 78e6a139-c7c6-4d89-9c55-2420ab31a2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6', 'volume_size': 1} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-435310228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e6a139-c7c6-4d89-9c55-2420ab31a2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cef4437831c40ddbd1c4778eac907a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:17Z,use_quota=True,user_id='a04ca8698c224b3e9562372f9f6e00d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Creating volume 78e6a139-c7c6-4d89-9c55-2420ab31a2f6 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:11:17 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:11:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:17 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 1073741824 Apr 29 18:11:17 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:18 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:11:18 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:19 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 1073741824" returned: 0 in 1.439s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:19 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 Apr 29 18:11:19 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:19 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.908s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:19 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:11:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fe13dbb4-8148-42e4-8047-80dfae29edbd tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Retype volume completed successfully. Apr 29 18:11:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Acquiring lock "cinder-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "cinder-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Acquiring lock "cinder-quobyte-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "cinder-quobyte-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[175dc6bd-0873-4231-9b44-f748e4830aa4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:20 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 Apr 29 18:11:20 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:20 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6" returned: 0 in 1.175s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] <== create_volume: return (2674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.678s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65feaa9a-2d21-47af-8ea7-3c4a8009ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2845f-cefa-4fb6-9791-587ec7d982a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:20 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Volume volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 (78e6a139-c7c6-4d89-9c55-2420ab31a2f6): created successfully Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2845f-cefa-4fb6-9791-587ec7d982a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Flow 'volume_create_manager' (dbc63dba-ff5c-44b6-aae2-0540de1fec5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-df3e3a54-f3e2-41e3-8bc2-d7f99bedbaa2 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Created volume successfully. Apr 29 18:11:21 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18" returned: 0 in 0.929s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:21 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18 Apr 29 18:11:21 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:22 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18" returned: 0 in 0.962s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "cinder-quobyte-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18" released by "delete_volume" :: held 1.958s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:22 devstack cinder-volume[84402]: WARNING cinder.quota [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:11:22 devstack cinder-volume[84402]: WARNING cinder.quota [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Created reservations ['9c4100c8-7ec6-407a-8e1d-5f878fd3fb4c', 'ec6be5ed-b1b6-4f67-8e33-8460f6a73454', 'c0faed19-0309-4292-940a-c41f03ab0c0f', '104ddc89-91c5-4dce-a874-c7d4d89ece66'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Acquiring lock "cinder-78e6a139-c7c6-4d89-9c55-2420ab31a2f6-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "cinder-78e6a139-c7c6-4d89-9c55-2420ab31a2f6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:22 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:11:22 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Acquiring lock "cinder-quobyte-78e6a139-c7c6-4d89-9c55-2420ab31a2f6" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "cinder-quobyte-78e6a139-c7c6-4d89-9c55-2420ab31a2f6" acquired by "delete_volume" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef21612-1440-446a-acf0-4abdaebe06bc]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:22 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 Apr 29 18:11:22 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:23 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6" returned: 0 in 1.241s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:23 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6 Apr 29 18:11:23 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:23 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.562s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:23 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:11:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Deleted volume successfully. Apr 29 18:11:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-95aa5b32-abbf-4cae-b646-6da7209ca7db tempest-VolumeRetypeWithoutMigrationTest-594662604 None] Lock "cinder-9d7d21ed-d708-4f7c-a5da-e57eea0e2d18-delete_volume" released by "delete_volume" :: held 3.927s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:24 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78e6a139-c7c6-4d89-9c55-2420ab31a2f6" returned: 0 in 1.013s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "cinder-quobyte-78e6a139-c7c6-4d89-9c55-2420ab31a2f6" released by "delete_volume" :: held 2.319s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Created reservations ['ebcfd525-bc8a-4dc6-8e93-13d839a841ec', '5f0e5427-c0d1-43db-aa5a-aba91d65dba4', '6de790ce-b75e-4dbd-96e8-0ed2be27c197', '874df9b2-ed05-4e30-b9ea-b56ec31d18f0'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:24 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:11:24 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:25 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.982s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:25 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:11:25 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Deleted volume successfully. Apr 29 18:11:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-456e5287-bdba-4c4c-a735-bb721842bd75 tempest-VolumeQuotasNegativeTestJSON-305395164 None] Lock "cinder-78e6a139-c7c6-4d89-9c55-2420ab31a2f6-delete_volume" released by "delete_volume" :: held 3.758s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Flow 'volume_create_manager' (456d9a30-b0c0-4d87-a175-785fccc820f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaec9fe-c4a0-4748-b900-bb0746a15aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaec9fe-c4a0-4748-b900-bb0746a15aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1912463054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd032dff-a1f4-4036-bd04-13d247eff61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f86773b74f460ab2c5894fd86f61c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:31Z,use_quota=True,user_id='a4ffac241b9b46e39dca68b69e608855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d302c4a6-8494-4ce3-9609-ae4a97f44741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d302c4a6-8494-4ce3-9609-ae4a97f44741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811477a1-133e-46c1-a8aa-1d3905d0ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811477a1-133e-46c1-a8aa-1d3905d0ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd032dff-a1f4-4036-bd04-13d247eff61f', 'volume_name': 'volume-bd032dff-a1f4-4036-bd04-13d247eff61f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6736bdf3-14d9-4825-ba4a-906832bd5be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6736bdf3-14d9-4825-ba4a-906832bd5be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e512efc6-fd59-46d3-a266-abeebffc0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Volume bd032dff-a1f4-4036-bd04-13d247eff61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd032dff-a1f4-4036-bd04-13d247eff61f', 'volume_size': 1} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1912463054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd032dff-a1f4-4036-bd04-13d247eff61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f86773b74f460ab2c5894fd86f61c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:31Z,use_quota=True,user_id='a4ffac241b9b46e39dca68b69e608855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Creating volume bd032dff-a1f4-4036-bd04-13d247eff61f {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:11:30 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:11:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:31 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f 1073741824 Apr 29 18:11:31 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:32 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f 1073741824" returned: 0 in 1.214s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:32 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f Apr 29 18:11:32 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Flow 'volume_create_manager' (35e4d6f7-58b1-4b10-9db5-4da085fd9899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be03034-4912-4a80-951d-ad14c5419e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:32 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f" returned: 0 in 0.746s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be03034-4912-4a80-951d-ad14c5419e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-743028394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae45875-6077-402e-87d9-ed61b9708d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05282ca0a8d541028092e956512811d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:33Z,use_quota=True,user_id='b66d7d5d0d6e409ea8a78f9908702c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea0d700-8e54-4628-9cc5-820784a3291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea0d700-8e54-4628-9cc5-820784a3291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a08305-60fd-48d8-8868-2e79fac099ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a08305-60fd-48d8-8868-2e79fac099ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae45875-6077-402e-87d9-ed61b9708d5b', 'volume_name': 'volume-4ae45875-6077-402e-87d9-ed61b9708d5b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8474a203-de6a-4dab-bdc5-ddbcc6e25a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8474a203-de6a-4dab-bdc5-ddbcc6e25a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10151d1-f9b5-476f-b6c6-0fa35b125464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:33 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Volume 4ae45875-6077-402e-87d9-ed61b9708d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae45875-6077-402e-87d9-ed61b9708d5b', 'volume_size': 1} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-743028394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae45875-6077-402e-87d9-ed61b9708d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05282ca0a8d541028092e956512811d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:11:33Z,use_quota=True,user_id='b66d7d5d0d6e409ea8a78f9908702c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Creating volume 4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:11:33 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e512efc6-fd59-46d3-a266-abeebffc0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd032dff-a1f4-4036-bd04-13d247eff61f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db8995b-0398-456c-a539-2f61cf59ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:33 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b 1073741824 Apr 29 18:11:33 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:33 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Volume volume-bd032dff-a1f4-4036-bd04-13d247eff61f (bd032dff-a1f4-4036-bd04-13d247eff61f): created successfully Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db8995b-0398-456c-a539-2f61cf59ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Flow 'volume_create_manager' (456d9a30-b0c0-4d87-a175-785fccc820f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-12006044-cd8f-4b55-b265-5b10c050efda tempest-VolumesServicesTestJSON-1288988915 None] Created volume successfully. Apr 29 18:11:33 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b 1073741824" returned: 0 in 0.822s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:33 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b Apr 29 18:11:33 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Acquiring lock "cinder-bd032dff-a1f4-4036-bd04-13d247eff61f-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Lock "cinder-bd032dff-a1f4-4036-bd04-13d247eff61f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Acquiring lock "cinder-quobyte-bd032dff-a1f4-4036-bd04-13d247eff61f" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Lock "cinder-quobyte-bd032dff-a1f4-4036-bd04-13d247eff61f" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90fcb6-f50f-4664-8e08-f57506fe9b41]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:34 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f Apr 29 18:11:34 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:34 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b" returned: 0 in 0.672s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10151d1-f9b5-476f-b6c6-0fa35b125464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae45875-6077-402e-87d9-ed61b9708d5b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1030c61-90f7-4ee2-9b08-72e4dfaddf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:11:34 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Volume volume-4ae45875-6077-402e-87d9-ed61b9708d5b (4ae45875-6077-402e-87d9-ed61b9708d5b): created successfully Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1030c61-90f7-4ee2-9b08-72e4dfaddf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:11:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Flow 'volume_create_manager' (35e4d6f7-58b1-4b10-9db5-4da085fd9899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:11:34 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1a18bcfc-8b2a-4651-ade9-2b7e1a1e46db tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Created volume successfully. Apr 29 18:11:35 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f" returned: 0 in 0.943s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:35 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f Apr 29 18:11:35 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Creating offline snapshot 5069794e-b856-48aa-9baf-a4a865800148 of volume 4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a1adca-05ee-4f5a-bd9f-7511677b19e1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:35 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b Apr 29 18:11:35 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:35 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:11:35 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:36 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bd032dff-a1f4-4036-bd04-13d247eff61f" returned: 0 in 0.977s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Lock "cinder-quobyte-bd032dff-a1f4-4036-bd04-13d247eff61f" released by "delete_volume" :: held 1.994s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Created reservations ['9e9c30c9-2fba-427b-befe-b82f179e29a9', '87af2f88-bf69-45b6-a213-ce3de9ef6f9b', 'fc9ff037-9165-4289-8f74-eb768f4bfc8d', 'bcf5f1da-a0bc-43db-b831-494522028086'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:11:36 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b" returned: 0 in 0.993s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:36 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 1G Apr 29 18:11:36 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:36 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:11:36 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:36 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.139s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:11:37 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.224s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:37 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:11:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Deleted volume successfully. Apr 29 18:11:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80f47e35-1366-4ddb-bf06-9da0fed09079 tempest-VolumesServicesTestJSON-1288988915 None] Lock "cinder-bd032dff-a1f4-4036-bd04-13d247eff61f-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:37 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 1G" returned: 0 in 1.375s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ae45875-6077-402e-87d9-ed61b9708d5b -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:37 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ae45875-6077-402e-87d9-ed61b9708d5b -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 Apr 29 18:11:37 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:38 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ae45875-6077-402e-87d9-ed61b9708d5b -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148" returned: 0 in 0.778s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:38 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 is being set with open permissions: ugo+rw Apr 29 18:11:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:38 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 Apr 29 18:11:38 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:39 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148" returned: 0 in 0.774s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:39 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info Apr 29 18:11:39 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:40 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info" returned: 0 in 0.715s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:40 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info is being set with open permissions: ugo+rw Apr 29 18:11:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:40 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info Apr 29 18:11:40 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:40 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.info" returned: 0 in 0.668s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.445s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:40 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-21448722-b0f9-435e-a6d5-5e47047dc4cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Create snapshot completed successfully Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "cinder-5069794e-b856-48aa-9baf-a4a865800148-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-5069794e-b856-48aa-9baf-a4a865800148-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "cinder-quobyte-4ae45875-6077-402e-87d9-ed61b9708d5b" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-quobyte-4ae45875-6077-402e-87d9-ed61b9708d5b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "cinder-quobyte-5069794e-b856-48aa-9baf-a4a865800148" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-quobyte-5069794e-b856-48aa-9baf-a4a865800148" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Deleting offline snapshot 5069794e-b856-48aa-9baf-a4a865800148 of volume 4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] snapshot_file for this snap is: volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec63e37-adc0-4ea1-8daf-95d13cde3596]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:42 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 Apr 29 18:11:42 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148" returned: 0 in 1.137s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ae45875-6077-402e-87d9-ed61b9708d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:11:43 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:43 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312bc84-f815-4d0b-8121-d6208ee4ea09]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:43 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b Apr 29 18:11:43 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:44 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b" returned: 0 in 0.913s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:44 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 Apr 29 18:11:44 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:45 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148" returned: 0 in 1.095s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:45 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148 Apr 29 18:11:45 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:46 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b.5069794e-b856-48aa-9baf-a4a865800148" returned: 0 in 1.015s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-quobyte-5069794e-b856-48aa-9baf-a4a865800148" released by "_delete_snapshot" :: held 4.371s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-quobyte-4ae45875-6077-402e-87d9-ed61b9708d5b" released by "delete_snapshot" :: held 4.408s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Created reservations ['be3d28d5-bd31-4f14-acf8-c2dd29b8961a', 'dfcbe238-2c1e-4c4e-9f1c-be83849a56a7', 'a9387694-3f25-48f8-979f-5ff3ca424a47', 'de7e93e9-b570-4eaf-82e2-f1b2947ba7ef'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:11:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Delete snapshot completed successfully. Apr 29 18:11:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-435018cd-d003-4871-949a-ff6612821d30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-5069794e-b856-48aa-9baf-a4a865800148-delete_snapshot" released by "delete_snapshot" :: held 4.601s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "cinder-4ae45875-6077-402e-87d9-ed61b9708d5b-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-4ae45875-6077-402e-87d9-ed61b9708d5b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "cinder-quobyte-4ae45875-6077-402e-87d9-ed61b9708d5b" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:11:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-quobyte-4ae45875-6077-402e-87d9-ed61b9708d5b" acquired by "delete_volume" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:11:48 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[354f0546-fd84-4f13-b19c-100abd2ab000]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:11:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:48 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b Apr 29 18:11:48 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:49 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b" returned: 0 in 1.089s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:49 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b Apr 29 18:11:49 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:50 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ae45875-6077-402e-87d9-ed61b9708d5b" returned: 0 in 1.301s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-quobyte-4ae45875-6077-402e-87d9-ed61b9708d5b" released by "delete_volume" :: held 2.481s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Created reservations ['4f43c84c-f487-4826-bc86-45a655f0ea09', '0cc7d3c7-edf9-4f85-a36d-3adf7055860d', '1100523c-64f0-4d17-8785-00987de5c6c4', '24367aa2-8a54-4e8a-a264-4cde6a1c4afb'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:11:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:11:50 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:11:50 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:11:52 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 29 18:11:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.443s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:11:52 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:11:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Deleted volume successfully. Apr 29 18:11:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4f2cb3e9-bc1b-44e0-a0a5-14b47a1a99d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1064889584 None] Lock "cinder-4ae45875-6077-402e-87d9-ed61b9708d5b-delete_volume" released by "delete_volume" :: held 4.368s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:00 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=48,cinder:UPDATE=55,cinder:DELETE=5,cinder:INSERT=11 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Flow 'volume_create_manager' (39270c9a-cc47-416f-bdfa-67340b439197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5ea917-3ef5-4949-a3c2-bdd6fd3fdc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5ea917-3ef5-4949-a3c2-bdd6fd3fdc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-662244347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04c1d10-437d-40de-a5cd-1aeaca9c634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3cdd057d21409a9e18e1b68120074b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:02Z,use_quota=True,user_id='2427a69417c6445c96bc7afe57eee15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1b47fd-c5f6-4bce-a6ca-8d122ebe67f6),volume_type_id=3f1b47fd-c5f6-4bce-a6ca-8d122ebe67f6)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036cc363-5321-4cc9-8592-b5fa21fea3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036cc363-5321-4cc9-8592-b5fa21fea3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6d0c46-8fee-4f2f-a189-58ff5a89c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6d0c46-8fee-4f2f-a189-58ff5a89c240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04c1d10-437d-40de-a5cd-1aeaca9c634a', 'volume_name': 'volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6850c2-7729-4b93-8a7f-e34777c5ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6850c2-7729-4b93-8a7f-e34777c5ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6d0f88-4c21-42c3-bdf8-ffb0b2e14823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Volume a04c1d10-437d-40de-a5cd-1aeaca9c634a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a', 'volume_size': 1} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-662244347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04c1d10-437d-40de-a5cd-1aeaca9c634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3cdd057d21409a9e18e1b68120074b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:02Z,use_quota=True,user_id='2427a69417c6445c96bc7afe57eee15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1b47fd-c5f6-4bce-a6ca-8d122ebe67f6),volume_type_id=3f1b47fd-c5f6-4bce-a6ca-8d122ebe67f6)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Creating volume a04c1d10-437d-40de-a5cd-1aeaca9c634a {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:02 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:02 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a 1073741824 Apr 29 18:12:02 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:03 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a 1073741824" returned: 0 in 1.369s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:03 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a Apr 29 18:12:03 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:04 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a" returned: 0 in 0.948s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6d0f88-4c21-42c3-bdf8-ffb0b2e14823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f5b272-d221-41f6-bd71-016263882472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:04 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Volume volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a (a04c1d10-437d-40de-a5cd-1aeaca9c634a): created successfully Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f5b272-d221-41f6-bd71-016263882472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Flow 'volume_create_manager' (39270c9a-cc47-416f-bdfa-67340b439197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fba5482e-c908-4eb1-a0bd-667ba3db8e38 tempest-VolumeTypesAccessTest-993224928 None] Created volume successfully. Apr 29 18:12:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Acquiring lock "cinder-a04c1d10-437d-40de-a5cd-1aeaca9c634a-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Lock "cinder-a04c1d10-437d-40de-a5cd-1aeaca9c634a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Acquiring lock "cinder-quobyte-a04c1d10-437d-40de-a5cd-1aeaca9c634a" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Lock "cinder-quobyte-a04c1d10-437d-40de-a5cd-1aeaca9c634a" acquired by "delete_volume" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec74b4-c9da-418e-96a3-43a8742cbf94]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:06 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a Apr 29 18:12:06 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (1700508e-5514-4c03-a1de-9acebee74c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec9b910-c3b0-459d-a8c9-a1bf33162f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec9b910-c3b0-459d-a8c9-a1bf33162f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107659920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22b5735-e1b8-4717-852c-cd8b9f3d17e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:07Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15bc12-9f90-48bc-8be6-fa6d88630715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15bc12-9f90-48bc-8be6-fa6d88630715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec35448-c711-4f07-bb22-15334c28dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec35448-c711-4f07-bb22-15334c28dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22b5735-e1b8-4717-852c-cd8b9f3d17e0', 'volume_name': 'volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b5dbce-81fd-4e0e-a561-e680f29da9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b5dbce-81fd-4e0e-a561-e680f29da9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b574fae4-0b5e-4cdb-b138-600c89c9b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Volume f22b5735-e1b8-4717-852c-cd8b9f3d17e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0', 'volume_size': 1} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107659920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22b5735-e1b8-4717-852c-cd8b9f3d17e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:07Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Creating volume f22b5735-e1b8-4717-852c-cd8b9f3d17e0 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:07 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:07 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 1073741824 Apr 29 18:12:07 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:07 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a" returned: 0 in 1.660s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:07 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a Apr 29 18:12:07 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:09 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 1073741824" returned: 0 in 1.600s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:09 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 Apr 29 18:12:09 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:09 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a04c1d10-437d-40de-a5cd-1aeaca9c634a" returned: 0 in 1.594s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Lock "cinder-quobyte-a04c1d10-437d-40de-a5cd-1aeaca9c634a" released by "delete_volume" :: held 3.366s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:09 devstack cinder-volume[84402]: WARNING cinder.quota [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1098489516 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1098489516, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:12:09 devstack cinder-volume[84402]: WARNING cinder.quota [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1098489516 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1098489516, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Created reservations ['5ffb0cf9-3e29-44e2-9ce0-960e9a76840d', '80e3fd16-3e0f-48b0-bc89-6fe05419420b', '49f9d3e4-7c8f-45a1-b98e-3d4361f20760', 'f5432ea3-850b-4d7b-a59b-ffb700c255c8'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:09 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:09 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:10 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" returned: 0 in 1.537s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] <== create_volume: return (3256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.261s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=71,cinder:SELECT=48,cinder:INSERT=17,cinder:DELETE=4 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b574fae4-0b5e-4cdb-b138-600c89c9b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a64e8c-833e-4ada-9bf7-d5ff5272ebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Volume volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 (f22b5735-e1b8-4717-852c-cd8b9f3d17e0): created successfully Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a64e8c-833e-4ada-9bf7-d5ff5272ebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (1700508e-5514-4c03-a1de-9acebee74c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b54c50ca-66c5-4dd2-adf1-b215dd3f8c87 tempest-VolumesActionsTest-295501478 None] Created volume successfully. Apr 29 18:12:11 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.427s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Deleted volume successfully. Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5464a75c-018b-47fb-a13b-919f51e475c7 tempest-VolumeTypesAccessTest-993224928 None] Lock "cinder-a04c1d10-437d-40de-a5cd-1aeaca9c634a-delete_volume" released by "delete_volume" :: held 5.293s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Flow 'volume_create_manager' (754d7c8a-7ccd-42be-9507-2c48da6e72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d46448-cd51-4c1d-b789-2d5db4c79517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d46448-cd51-4c1d-b789-2d5db4c79517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc412a60e07c473bb88e7b788ee645d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:12Z,use_quota=True,user_id='84977bfecb3d450ebddab9550b8e8f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26ce549-2b73-4bc0-99b0-f9cc427b043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26ce549-2b73-4bc0-99b0-f9cc427b043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b78e8e9-582d-4855-a0f1-214d72e62e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:11 devstack cinder-volume[84402]: DEBUG cinder.image.glance [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Creating Keystone auth plugin from conf {{(pid=84402) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 18:12:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b689e3de-ad0f-463b-be7e-74fd7ac4d32d tempest-VolumesActionsTest-295501478 None] Acquiring lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" by "attach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b689e3de-ad0f-463b-be7e-74fd7ac4d32d tempest-VolumesActionsTest-295501478 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" acquired by "attach_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b689e3de-ad0f-463b-be7e-74fd7ac4d32d tempest-VolumesActionsTest-295501478 None] Attaching volume f22b5735-e1b8-4717-852c-cd8b9f3d17e0 to instance 0dca6adb-70be-4211-86a7-e0390556af16 at mountpoint /dev/vdb on host None. Apr 29 18:12:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b689e3de-ad0f-463b-be7e-74fd7ac4d32d tempest-VolumesActionsTest-295501478 None] Attach volume completed successfully. Apr 29 18:12:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b689e3de-ad0f-463b-be7e-74fd7ac4d32d tempest-VolumesActionsTest-295501478 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" released by "attach_volume" :: held 0.150s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b78e8e9-582d-4855-a0f1-214d72e62e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c', 'volume_name': 'volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f9979e-c7e0-4968-a921-c45c8e29659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f9979e-c7e0-4968-a921-c45c8e29659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9558312-6e46-4dc2-b983-4800daf0d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:13 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Volume 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 18:12:13 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Trying to clone 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]). {{(pid=84402) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 18:12:14 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 18:12:14 devstack cinder-volume[84402]: INFO cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Image download 20.69 MB at 20.69 MB/s Apr 29 18:12:14 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fb64533f-43e1-4fb5-a0d9-ba07fe014040 tempest-VolumesActionsTest-2134579970 None] Terminate volume connection completed successfully. Apr 29 18:12:14 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2604c2b-aa8a-4b16-8eb4-ce64f811c394]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:14 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD Apr 29 18:12:14 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fb64533f-43e1-4fb5-a0d9-ba07fe014040 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-detach_volume" by "detach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fb64533f-43e1-4fb5-a0d9-ba07fe014040 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:14 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fb64533f-43e1-4fb5-a0d9-ba07fe014040 tempest-VolumesActionsTest-2134579970 None] Detaching volume f22b5735-e1b8-4717-852c-cd8b9f3d17e0 from instance 0dca6adb-70be-4211-86a7-e0390556af16. Apr 29 18:12:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fb64533f-43e1-4fb5-a0d9-ba07fe014040 tempest-VolumesActionsTest-2134579970 None] Detach volume completed successfully. Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fb64533f-43e1-4fb5-a0d9-ba07fe014040 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:15 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9baa604f-c581-4c63-8ee5-b35fa8d64869 tempest-VolumesActionsTest-295501478 None] Acquiring lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-detach_volume" by "detach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD" returned: 0 in 1.364s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 is fetched for user 84977bfecb3d450ebddab9550b8e8f16. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9baa604f-c581-4c63-8ee5-b35fa8d64869 tempest-VolumesActionsTest-295501478 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9baa604f-c581-4c63-8ee5-b35fa8d64869 tempest-VolumesActionsTest-295501478 None] Volume detach called, but volume not attached. Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9baa604f-c581-4c63-8ee5-b35fa8d64869 tempest-VolumesActionsTest-295501478 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[964559c9-5a38-4c67-93d9-9117abf736ab]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:16 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD Apr 29 18:12:16 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Acquiring lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Acquiring lock "cinder-quobyte-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Lock "cinder-quobyte-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:16 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd560954-d387-4a93-9228-da721f82c712]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:17 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 Apr 29 18:12:17 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:17 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD" returned: 0 in 1.306s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc412a60e07c473bb88e7b788ee645d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:12Z,use_quota=True,user_id='84977bfecb3d450ebddab9550b8e8f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Creating volume 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:17 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:17 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c 1073741824 Apr 29 18:12:17 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:18 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" returned: 0 in 1.208s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:18 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0 Apr 29 18:12:18 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Flow 'volume_create_manager' (9a795418-5f85-4684-9ae5-c04e9f81f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf3a8cf-c567-429a-8a6e-0667bc4f5393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf3a8cf-c567-429a-8a6e-0667bc4f5393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1812635097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e93f92-de74-4b9c-ba18-3fdcfdc772f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5a89607de44a3aa2406162e46669a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:18Z,use_quota=True,user_id='e9206c5b910a479e8247cdf3dd3a3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c83052-7386-4c6c-af2c-552bbb82237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c83052-7386-4c6c-af2c-552bbb82237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83581977-28b7-41bf-ba92-6e1345c7c059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83581977-28b7-41bf-ba92-6e1345c7c059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'volume_name': 'volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c999fd77-4f45-4084-80bb-f4b8066483b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c999fd77-4f45-4084-80bb-f4b8066483b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c2c98e-8f26-45d1-9afd-1317d6cbbd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:18 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Volume f3e93f92-de74-4b9c-ba18-3fdcfdc772f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'volume_size': 1} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:18 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c 1073741824" returned: 0 in 1.200s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:18 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:12:18 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:18 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" returned: 0 in 0.696s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Lock "cinder-quobyte-f22b5735-e1b8-4717-852c-cd8b9f3d17e0" released by "delete_volume" :: held 1.981s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Created reservations ['4e903745-6099-4e19-8f1c-07a637d06e20', 'bbbb36d1-0474-4de0-a80f-8bd7a2a0c781', 'aa0c40a9-245d-41da-8c22-d51f19139622', '112e388c-1643-4020-9579-d0f18c6a2c2e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:18 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:18 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:19 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 0 in 0.859s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1812635097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e93f92-de74-4b9c-ba18-3fdcfdc772f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5a89607de44a3aa2406162e46669a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:18Z,use_quota=True,user_id='e9206c5b910a479e8247cdf3dd3a3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Creating volume f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:19 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:19 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 1073741824 Apr 29 18:12:19 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Attempting download of 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6dbbc2-ffb7-4a4c-ba08-25ff4041ab02]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:19 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8 Apr 29 18:12:19 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:19 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.888s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Deleted volume successfully. Apr 29 18:12:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5436430-e34e-42bb-9dc8-7a1dfcae4f55 tempest-VolumesActionsTest-295501478 None] Lock "cinder-f22b5735-e1b8-4717-852c-cd8b9f3d17e0-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:20 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 1073741824" returned: 0 in 1.060s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:20 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:20 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:20 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8" returned: 0 in 1.025s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:20 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8 Apr 29 18:12:20 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:21 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.857s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c2c98e-8f26-45d1-9afd-1317d6cbbd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae053d6-7361-4136-af13-33056d494aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:21 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Volume volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 (f3e93f92-de74-4b9c-ba18-3fdcfdc772f4): created successfully Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae053d6-7361-4136-af13-33056d494aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Flow 'volume_create_manager' (9a795418-5f85-4684-9ae5-c04e9f81f59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:21 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0ea555a9-9eca-4c25-81ee-2a6138e53e32 tempest-VolumesCloneTest-2137842680 None] Created volume successfully. Apr 29 18:12:21 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8" returned: 1 in 0.909s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_zojd6kx8' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea6f93-69b2-449f-9d29-6c8b89c38878]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:21 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD Apr 29 18:12:21 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:22 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD" returned: 0 in 0.797s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:22 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 was qcow2, converting to raw {{(pid=84402) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 18:12:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:22 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:12:22 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Flow 'volume_create_manager' (9fb4d606-563c-4742-ae00-bc19c3075c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dec746b-410d-4146-ac19-550b49dfe964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dec746b-410d-4146-ac19-550b49dfe964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1579613432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f75203-4553-4c07-b8d7-e96e9aed2804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5a89607de44a3aa2406162e46669a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f3e93f92-de74-4b9c-ba18-3fdcfdc772f4,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:23Z,use_quota=True,user_id='e9206c5b910a479e8247cdf3dd3a3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd784e88-4e98-40a3-8564-fcdbdbc927f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd784e88-4e98-40a3-8564-fcdbdbc927f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8d3fe6-fdc3-4a1a-8e2c-27c7e70e05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8d3fe6-fdc3-4a1a-8e2c-27c7e70e05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '26f75203-4553-4c07-b8d7-e96e9aed2804', 'volume_name': 'volume-26f75203-4553-4c07-b8d7-e96e9aed2804', 'volume_size': 2, 'source_volid': 'f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e0402f-cbab-40ad-bc77-407936064fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e0402f-cbab-40ad-bc77-407936064fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe8c1e8-03e1-493f-98a2-9e2fd84f1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:23 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Volume 26f75203-4553-4c07-b8d7-e96e9aed2804: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-26f75203-4553-4c07-b8d7-e96e9aed2804', 'volume_size': 2, 'source_volid': 'f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'source_volstatus': 'available'} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:23 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Cloning volume f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 to volume 26f75203-4553-4c07-b8d7-e96e9aed2804 Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Creating offline snapshot 493b44f1-9fac-45ec-923a-b6edd77c5456 of volume f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adabfab-d136-44df-b7c1-606c7c6ec57e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:23 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:23 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:24 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.867s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:24 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 1G Apr 29 18:12:24 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Flow 'volume_create_manager' (55528649-7542-4c15-bee4-6ea16f266eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17848f09-6012-46ca-b7a9-649d3e865b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17848f09-6012-46ca-b7a9-649d3e865b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1339937740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d30cb3b-b50b-490d-95dc-4384b534b34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933fb077298446e5831f0556b3e78d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:25Z,use_quota=True,user_id='0ea427e41beb467da401d601512d75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc65d7db-153e-4b07-b5b3-8e3ee8f619a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc65d7db-153e-4b07-b5b3-8e3ee8f619a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f579bd5-aae6-4446-926e-67a12aa029b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.image.glance [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Creating Keystone auth plugin from conf {{(pid=84402) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 18:12:24 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 0 in 2.410s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_3jl2uso6devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:12:24 devstack cinder-volume[84402]: INFO cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Converted 112.00 MB image at 46.45 MB/s Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:24 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c 1G Apr 29 18:12:24 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f579bd5-aae6-4446-926e-67a12aa029b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d30cb3b-b50b-490d-95dc-4384b534b34c', 'volume_name': 'volume-8d30cb3b-b50b-490d-95dc-4384b534b34c', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9edff47-ce3b-40e5-9f51-89752701b5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9edff47-ce3b-40e5-9f51-89752701b5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfc07ff-1ab5-4f5e-800c-f6fcc5fe46d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Volume 8d30cb3b-b50b-490d-95dc-4384b534b34c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d30cb3b-b50b-490d-95dc-4384b534b34c', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Trying to clone 8d30cb3b-b50b-490d-95dc-4384b534b34c from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]). {{(pid=84402) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 18:12:25 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 1G" returned: 0 in 0.945s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:25 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 Apr 29 18:12:25 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 18:12:25 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Image download 20.69 MB at 20.69 MB/s Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bca6d0-58f9-4e12-9f91-cf5a2f36dda4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:25 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c 1G" returned: 0 in 0.796s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:25 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD Apr 29 18:12:25 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fd5e91-4c01-4a1c-b1b2-d3dbb880dbcd]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:25 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:12:25 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:26 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456" returned: 0 in 0.841s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:26 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 is being set with open permissions: ugo+rw Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:26 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 Apr 29 18:12:26 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:26 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 is fetched for user 0ea427e41beb467da401d601512d75b2. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a45248a-ec55-47b6-a3b9-e2ac68bc1c81]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:26 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD Apr 29 18:12:26 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:26 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 0 in 0.825s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:26 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:12:26 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:26 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456" returned: 0 in 0.751s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:26 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info Apr 29 18:12:26 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:27 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:27 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 1 in 0.759s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Downloaded image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c successfully. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 for user 84977bfecb3d450ebddab9550b8e8f16 is deleted. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Marking volume 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c as bootable. {{(pid=84402) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Copying metadata from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 to 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c. {{(pid=84402) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Creating volume glance metadata for volume 8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c backed by image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84402) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9558312-6e46-4dc2-b983-4800daf0d92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e50138e-19d5-49a9-9bb0-135c811298b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:27 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Volume volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c (8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c): created successfully Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e50138e-19d5-49a9-9bb0-135c811298b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Flow 'volume_create_manager' (754d7c8a-7ccd-42be-9507-2c48da6e72ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:27 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-5a690183-ecce-43a2-91fc-b1cfdf102e5a tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Created volume successfully. Apr 29 18:12:27 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info" returned: 0 in 0.674s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:27 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info is being set with open permissions: ugo+rw Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:27 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info Apr 29 18:12:27 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (9e038f59-49b4-4de8-b721-27a5b11381b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c438cdb-bdca-49a0-9554-d7d4eefadacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c438cdb-bdca-49a0-9554-d7d4eefadacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058812787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8eac4c-e613-41dd-90d5-7cb8d5caae8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:28Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a129c31f-77e3-41cc-8fc8-d94b8baea1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a129c31f-77e3-41cc-8fc8-d94b8baea1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c891500-87cd-461d-89ae-5d6a17775a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c891500-87cd-461d-89ae-5d6a17775a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8eac4c-e613-41dd-90d5-7cb8d5caae8d', 'volume_name': 'volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099b3712-6dde-4d57-ba00-fd95003ba7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099b3712-6dde-4d57-ba00-fd95003ba7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b62d368-cc44-443c-83ba-154fb06fd3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Volume 7f8eac4c-e613-41dd-90d5-7cb8d5caae8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d', 'volume_size': 1} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:28 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.info" returned: 0 in 0.670s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "cinder-quobyte-26f75203-4553-4c07-b8d7-e96e9aed2804" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-26f75203-4553-4c07-b8d7-e96e9aed2804" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] snapshot: 493b44f1-9fac-45ec-923a-b6edd77c5456, volume: 26f75203-4553-4c07-b8d7-e96e9aed2804, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62e6c4-c4fc-43d5-a8fc-5cd82030c44d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:28 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 Apr 29 18:12:28 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:28 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456" returned: 0 in 0.697s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4590d68b-2a54-4953-a938-fc5bf9a0bac7]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:29 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:29 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:29 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.695s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:29 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:12:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:29 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 Apr 29 18:12:29 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:34 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804" returned: 0 in 4.784s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:34 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68e50ac-067e-47d1-af3f-f675ee4edd4c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:34 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:34 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:35 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.824s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:12:35 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Converted 1024.00 MB image at 214.00 MB/s Apr 29 18:12:35 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 is being set with open permissions: ugo+rw Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:35 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 Apr 29 18:12:35 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:35 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:35 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:35 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804" returned: 0 in 0.586s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-26f75203-4553-4c07-b8d7-e96e9aed2804" released by "_copy_volume_from_snapshot" :: held 7.661s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "cinder-quobyte-493b44f1-9fac-45ec-923a-b6edd77c5456" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-493b44f1-9fac-45ec-923a-b6edd77c5456" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Deleting offline snapshot 493b44f1-9fac-45ec-923a-b6edd77c5456 of volume f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] snapshot_file for this snap is: volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8fdfa7-0e5b-4835-a1d6-5993fa5ce84e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:36 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 Apr 29 18:12:36 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:36 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.589s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:36 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456" returned: 0 in 0.740s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:12:36 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[368d9ed1-f605-4241-9d61-1ecc4c1ed020]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:36 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:36 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:37 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:37 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 Apr 29 18:12:37 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:37 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=40,cinder:INSERT=16,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:12:38 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456" returned: 0 in 0.683s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:38 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456 Apr 29 18:12:38 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:38 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4.493b44f1-9fac-45ec-923a-b6edd77c5456" returned: 0 in 0.591s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-493b44f1-9fac-45ec-923a-b6edd77c5456" released by "_delete_snapshot" :: held 2.783s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.399s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.623s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1339937740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d30cb3b-b50b-490d-95dc-4384b534b34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933fb077298446e5831f0556b3e78d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:25Z,use_quota=True,user_id='0ea427e41beb467da401d601512d75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Creating volume 8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:38 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe8c1e8-03e1-493f-98a2-9e2fd84f1988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f75203-4553-4c07-b8d7-e96e9aed2804', 'volume_size': 2, 'source_volid': 'f3e93f92-de74-4b9c-ba18-3fdcfdc772f4', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:38 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c 1073741824 Apr 29 18:12:38 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0e0367-f8f4-4b15-8dff-015a7661e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:38 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Volume volume-26f75203-4553-4c07-b8d7-e96e9aed2804 (26f75203-4553-4c07-b8d7-e96e9aed2804): created successfully Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0e0367-f8f4-4b15-8dff-015a7661e81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:38 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Flow 'volume_create_manager' (9fb4d606-563c-4742-ae00-bc19c3075c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:38 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0a288f47-3730-4e8b-9f58-fe2ed13fea21 tempest-VolumesCloneTest-2137842680 None] Created volume successfully. Apr 29 18:12:39 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c 1073741824" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:39 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:39 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Acquiring lock "cinder-26f75203-4553-4c07-b8d7-e96e9aed2804-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Lock "cinder-26f75203-4553-4c07-b8d7-e96e9aed2804-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Acquiring lock "cinder-quobyte-26f75203-4553-4c07-b8d7-e96e9aed2804" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-26f75203-4553-4c07-b8d7-e96e9aed2804" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fc926-0d3b-4da3-8949-b8adb21c72cc]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:40 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 Apr 29 18:12:40 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:40 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 0 in 0.621s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.146s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Attempting download of 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume 8d30cb3b-b50b-490d-95dc-4384b534b34c. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8a81b1-c413-44ac-9ea3-fd96f483d792]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f53104-365f-485e-a0d9-f99ec7b81db2]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:40 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:12:40 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:40 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk Apr 29 18:12:40 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:40 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804" returned: 0 in 0.734s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:40 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804 Apr 29 18:12:40 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:40 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 0 in 0.738s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:40 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk" returned: 0 in 0.770s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:41 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:12:41 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:41 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk Apr 29 18:12:41 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:41 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-26f75203-4553-4c07-b8d7-e96e9aed2804" returned: 0 in 0.632s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-26f75203-4553-4c07-b8d7-e96e9aed2804" released by "delete_volume" :: held 1.415s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Created reservations ['c23ffbc9-fb4e-47e9-b2fc-01fa13da3d39', 'e2f07b6a-ce01-4eb1-908b-495dfe41356a', '30bc93e1-712d-4f57-b64f-f4b484f00cd2', '3fb8a724-88e9-4478-aba2-e492829416db'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:41 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:41 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:41 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 1 in 0.813s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.602s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.693s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058812787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8eac4c-e613-41dd-90d5-7cb8d5caae8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:28Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Creating volume 7f8eac4c-e613-41dd-90d5-7cb8d5caae8d {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:41 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:41 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d 1073741824 Apr 29 18:12:41 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:41 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk" returned: 1 in 0.777s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_0z3tw9kk' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c8a27-f441-4a85-8cd2-b943baa37812]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61', 'name': 'volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79571839-1ac9-45b9-886d-2b3d0b784c0a', 'enforce_multipath': True} {{(pid=84402) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 18:12:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-5022932d-c207-4ed0-85d8-6275fc6fecf2 req-6a220627-4e59-4ecd-8338-329c02bab026 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] attachment_update completed successfully. Apr 29 18:12:41 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD Apr 29 18:12:41 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:42 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.655s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "cinder-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Deleted volume successfully. Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-081a212b-66ea-4fe7-826d-e7bb757a635a tempest-VolumesCloneTest-2137842680 None] Lock "cinder-26f75203-4553-4c07-b8d7-e96e9aed2804-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "cinder-quobyte-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da467e6-1808-45a2-8afa-eb32d4cffb15]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:42 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:42 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:42 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d 1073741824" returned: 0 in 0.818s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:42 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d Apr 29 18:12:42 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:42 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 was qcow2, converting to raw {{(pid=84402) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 18:12:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:42 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:42 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:43 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.907s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:43 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4 Apr 29 18:12:43 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:43 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d" returned: 0 in 0.663s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b62d368-cc44-443c-83ba-154fb06fd3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cb7274-b0c4-4edb-8a55-9f2b0a31532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:43 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Volume volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d (7f8eac4c-e613-41dd-90d5-7cb8d5caae8d): created successfully Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cb7274-b0c4-4edb-8a55-9f2b0a31532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (9e038f59-49b4-4de8-b721-27a5b11381b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-869d015f-5181-499b-a6af-fdcfdc472f01 tempest-VolumesActionsTest-295501478 None] Created volume successfully. Apr 29 18:12:43 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" returned: 0 in 0.652s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-quobyte-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4" released by "delete_volume" :: held 1.623s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Created reservations ['1bb35b3f-38e2-48d3-8a72-e659152df54b', '438f0bd0-0d0f-4df4-aa39-97e840e8f880', '8553b32a-5bba-4dee-a390-c4c40b35fdca', '7df1447a-d9b7-46f8-ae45-6119c3c3814a'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:43 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:43 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-quobyte-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed499c-032b-41a3-bef0-35edba9a7bdf]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:44 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d Apr 29 18:12:44 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:44 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.735s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Deleted volume successfully. Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40bc1c2e-6ae5-4d00-a7e4-daad23a94c18 tempest-VolumesCloneTest-2137842680 None] Lock "cinder-f3e93f92-de74-4b9c-ba18-3fdcfdc772f4-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:44 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 0 in 2.293s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_ksztbovgdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:12:44 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Converted 112.00 MB image at 48.83 MB/s Apr 29 18:12:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:45 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c 1G Apr 29 18:12:45 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:45 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d" returned: 0 in 0.811s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:45 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d Apr 29 18:12:45 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:45 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c 1G" returned: 0 in 0.854s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:45 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d968f85-41b2-4e6e-b0e5-535f1843e1cb]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:46 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:46 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:46 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d" returned: 0 in 0.789s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d" released by "delete_volume" :: held 1.675s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Created reservations ['c1b292c4-573e-427d-b77d-c706d9c0ea80', '8ec75b5a-2943-44e8-9ba8-86bb5113b296', '84a428c9-ef22-4223-8b82-3c61b1bfa6b7', 'af56c2a7-08a4-4a4f-ad59-3e30e832f0e2'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:46 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:46 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:46 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 0 in 0.977s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:47 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.743s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:47 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Deleted volume successfully. Apr 29 18:12:47 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b603557-b921-4fbe-8ae9-08231fda3096 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-7f8eac4c-e613-41dd-90d5-7cb8d5caae8d-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (2d4f8cd5-cfdf-49f9-b038-922bbd8f97d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e067f7bb-a21c-408c-86a6-6d7e47f81c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e067f7bb-a21c-408c-86a6-6d7e47f81c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-182179513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e409da39-207d-412e-a515-858ee83d08d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:47Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f2b5e3-6ce4-4241-8e10-c185903ee5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f2b5e3-6ce4-4241-8e10-c185903ee5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2078cc9-cd93-491a-a16b-2ff9ba471601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2078cc9-cd93-491a-a16b-2ff9ba471601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e409da39-207d-412e-a515-858ee83d08d8', 'volume_name': 'volume-e409da39-207d-412e-a515-858ee83d08d8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d30ec3e-e35e-4f8e-819e-2b4822357f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d30ec3e-e35e-4f8e-819e-2b4822357f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ec1b91-1616-4f9a-afbe-f35d80e6caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:47 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Volume e409da39-207d-412e-a515-858ee83d08d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e409da39-207d-412e-a515-858ee83d08d8', 'volume_size': 1} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-182179513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e409da39-207d-412e-a515-858ee83d08d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:47Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Creating volume e409da39-207d-412e-a515-858ee83d08d8 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:47 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:47 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 1073741824 Apr 29 18:12:47 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:48 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 1 in 1.538s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Downloaded image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume 8d30cb3b-b50b-490d-95dc-4384b534b34c successfully. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 for user 0ea427e41beb467da401d601512d75b2 is deleted. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Marking volume 8d30cb3b-b50b-490d-95dc-4384b534b34c as bootable. {{(pid=84402) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Flow 'volume_create_manager' (48ad53ed-8f8d-4f27-91a3-8b6c1ea534f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191ddee2-b921-49fb-a0a6-4c4fe904c586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Copying metadata from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 to 8d30cb3b-b50b-490d-95dc-4384b534b34c. {{(pid=84402) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Creating volume glance metadata for volume 8d30cb3b-b50b-490d-95dc-4384b534b34c backed by image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84402) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191ddee2-b921-49fb-a0a6-4c4fe904c586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-681585664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e2f0bf8d27425c89af536b3b4a8fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:48Z,use_quota=True,user_id='a5ac848f54784851b90e6f1d39d59fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00c1af8-e90d-4221-984d-2504720161fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00c1af8-e90d-4221-984d-2504720161fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98858bb4-4f24-4c13-97d2-bdd1242508c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98858bb4-4f24-4c13-97d2-bdd1242508c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2', 'volume_name': 'volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2', 'volume_size': 2}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76e16aa-291e-4d29-86c8-bcd5e31a2f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76e16aa-291e-4d29-86c8-bcd5e31a2f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e457d6fc-c8a7-4be9-82d9-10d3d1c189a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Volume e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2', 'volume_size': 2} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfc07ff-1ab5-4f5e-800c-f6fcc5fe46d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d30cb3b-b50b-490d-95dc-4384b534b34c', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da1ab0e-6a32-470f-b9f9-dbbe7c3a8ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Volume volume-8d30cb3b-b50b-490d-95dc-4384b534b34c (8d30cb3b-b50b-490d-95dc-4384b534b34c): created successfully Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da1ab0e-6a32-470f-b9f9-dbbe7c3a8ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Flow 'volume_create_manager' (55528649-7542-4c15-bee4-6ea16f266eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:48 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-627ffe9a-c4b7-4f10-89d4-ddee395b5dc3 tempest-VolumesImageMetadata-49480829 None] Created volume successfully. Apr 29 18:12:48 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 1073741824" returned: 0 in 1.318s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:48 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 Apr 29 18:12:48 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:49 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8" returned: 0 in 0.619s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-681585664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e2f0bf8d27425c89af536b3b4a8fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:48Z,use_quota=True,user_id='a5ac848f54784851b90e6f1d39d59fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Creating volume e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:49 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 2147483648 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ec1b91-1616-4f9a-afbe-f35d80e6caab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e409da39-207d-412e-a515-858ee83d08d8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:49 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 2147483648 Apr 29 18:12:49 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c6f9c2-e5db-4b02-8e20-76f7061e377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:49 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Volume volume-e409da39-207d-412e-a515-858ee83d08d8 (e409da39-207d-412e-a515-858ee83d08d8): created successfully Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c6f9c2-e5db-4b02-8e20-76f7061e377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (2d4f8cd5-cfdf-49f9-b038-922bbd8f97d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1270cadd-f98a-432e-a2a4-0aba84e302bb tempest-VolumesActionsTest-295501478 None] Created volume successfully. Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Acquiring lock "cinder-8d30cb3b-b50b-490d-95dc-4384b534b34c-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Lock "cinder-8d30cb3b-b50b-490d-95dc-4384b534b34c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Acquiring lock "cinder-quobyte-8d30cb3b-b50b-490d-95dc-4384b534b34c" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Lock "cinder-quobyte-8d30cb3b-b50b-490d-95dc-4384b534b34c" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48fd101-c819-48f5-98fc-df34837ca515]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:50 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:50 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:50 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 2147483648" returned: 0 in 1.347s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-e409da39-207d-412e-a515-858ee83d08d8-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-e409da39-207d-412e-a515-858ee83d08d8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:51 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 Apr 29 18:12:51 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-quobyte-e409da39-207d-412e-a515-858ee83d08d8" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-e409da39-207d-412e-a515-858ee83d08d8" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05f516a-5be7-41dc-b3e9-f1d4732712b4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:51 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 Apr 29 18:12:51 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:51 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 0 in 0.992s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:51 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:51 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:52 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2" returned: 0 in 1.128s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e457d6fc-c8a7-4be9-82d9-10d3d1c189a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2', 'volume_size': 2}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d39377f-6ddc-45c5-9e40-73b6317490e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:52 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Volume volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 (e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2): created successfully Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d39377f-6ddc-45c5-9e40-73b6317490e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Flow 'volume_create_manager' (48ad53ed-8f8d-4f27-91a3-8b6c1ea534f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5afbbb2f-6a63-4cd9-a391-213bc0c91669 tempest-VolumesCloneNegativeTest-635979217 None] Created volume successfully. Apr 29 18:12:52 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8" returned: 0 in 1.118s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:52 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8 Apr 29 18:12:52 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:52 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 1 in 1.236s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:12:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:52 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c Apr 29 18:12:52 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:53 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e409da39-207d-412e-a515-858ee83d08d8" returned: 0 in 0.823s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-e409da39-207d-412e-a515-858ee83d08d8" released by "delete_volume" :: held 2.011s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Created reservations ['f240b19e-6499-4f95-977c-75d8d92d096e', 'd874d588-75c3-478b-a916-0bb8e7dfb8fe', 'eba5f6e6-d532-4c58-97dd-0ee5b5268580', '6eb5a72e-170f-4407-aa0f-10375462b422'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Acquiring lock "cinder-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Lock "cinder-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:53 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:53 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Acquiring lock "cinder-quobyte-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Lock "cinder-quobyte-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2" acquired by "delete_volume" :: waited 0.045s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f607ead-e9b4-4a72-9002-41521d9b0968]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:53 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8d30cb3b-b50b-490d-95dc-4384b534b34c" returned: 0 in 1.145s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Lock "cinder-quobyte-8d30cb3b-b50b-490d-95dc-4384b534b34c" released by "delete_volume" :: held 3.496s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Created reservations ['96545ee9-cbbd-4912-8aee-8c8ecb38a61f', '0e5c4f48-5306-4b94-b14f-6e2226bb1eac', 'efe38ffc-9ad2-4d7f-b354-c948db79adcf', '25dd49b4-43e2-49b4-abe1-bbec8906e2a3'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:53 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 Apr 29 18:12:53 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:53 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:53 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:54 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.960s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:54 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:54 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Deleted volume successfully. Apr 29 18:12:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a40e4be5-598d-47e5-89c9-9b92ab56f9a7 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-e409da39-207d-412e-a515-858ee83d08d8-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:54 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2" returned: 0 in 1.362s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:54 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.166s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:55 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2 Apr 29 18:12:55 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:55 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Deleted volume successfully. Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59830c75-0b2c-4290-8485-853f95ce84d5 tempest-VolumesImageMetadata-49480829 None] Lock "cinder-8d30cb3b-b50b-490d-95dc-4384b534b34c-delete_volume" released by "delete_volume" :: held 5.042s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (33aa3323-895e-4389-9ae9-9e306f63b194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3563f524-cfa2-4b9d-9f74-b56a92610261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3563f524-cfa2-4b9d-9f74-b56a92610261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-15383785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7f5c6e-2751-4332-89f6-c9e9db10dc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:55Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e938b097-fe6d-46fb-85a0-804dbc170015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e938b097-fe6d-46fb-85a0-804dbc170015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ab347d-36d2-448b-ba8e-bdedfb12778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ab347d-36d2-448b-ba8e-bdedfb12778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7f5c6e-2751-4332-89f6-c9e9db10dc5f', 'volume_name': 'volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469a4b95-7fc0-4f0e-99d6-29c59676ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469a4b95-7fc0-4f0e-99d6-29c59676ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034a599-7f82-4f36-89ef-e3a48245d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:55 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Volume 5d7f5c6e-2751-4332-89f6-c9e9db10dc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f', 'volume_size': 1} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-15383785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7f5c6e-2751-4332-89f6-c9e9db10dc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:12:55Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Creating volume 5d7f5c6e-2751-4332-89f6-c9e9db10dc5f {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:12:55 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:55 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f 1073741824 Apr 29 18:12:55 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:55 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2" returned: 0 in 1.049s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Lock "cinder-quobyte-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2" released by "delete_volume" :: held 2.492s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Created reservations ['b296da4d-51be-4dc2-9ba5-afca738b72e6', 'a504dacb-7208-43f8-abbb-0ab7a58094bb', '730dbd96-ffc6-4c09-a3d1-18d8fa6ac580', '34c8555d-5742-42a8-916b-123d5e3ddcf6'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:56 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:12:56 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:56 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f 1073741824" returned: 0 in 1.083s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:56 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f Apr 29 18:12:56 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:12:56 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.826s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:12:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Deleted volume successfully. Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fe771a47-9752-47ce-8a3d-e620d3d145e2 tempest-VolumesCloneNegativeTest-635979217 None] Lock "cinder-e8f1bbca-ee01-4ef7-bbe9-0227dd4e90f2-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:12:57 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f" returned: 0 in 0.688s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034a599-7f82-4f36-89ef-e3a48245d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b499c1-eedd-44df-b106-3fb00deb9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:12:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Volume volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f (5d7f5c6e-2751-4332-89f6-c9e9db10dc5f): created successfully Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b499c1-eedd-44df-b106-3fb00deb9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:12:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (33aa3323-895e-4389-9ae9-9e306f63b194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:12:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8fcc0a92-ce6d-4e4a-adea-7ed48b60154b tempest-VolumesActionsTest-295501478 None] Created volume successfully. Apr 29 18:12:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-quobyte-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:12:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:12:59 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[576baf5a-a5a9-40a9-8972-55489e953c14]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:12:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:12:59 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f Apr 29 18:12:59 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:00 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f" returned: 0 in 0.805s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:00 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f Apr 29 18:13:00 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:01 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f" returned: 0 in 0.638s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f" released by "delete_volume" :: held 1.495s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:01 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Created reservations ['e0cf8362-97fc-4b9e-9b4a-5790aa971c77', 'ffce07f7-2b26-4102-ad3f-e26557f3a2e0', 'c81d96a5-bb40-49ef-8dac-251136bbb450', 'f179ece3-7b1d-4e75-9566-2de3a450146d'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:02 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:02 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.717s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:02 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Deleted volume successfully. Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bd440621-f62c-4c62-bef7-9ffe05aa1f35 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-5d7f5c6e-2751-4332-89f6-c9e9db10dc5f-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (f7886126-be41-4b1d-8461-f5b487f38ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd271455-8b44-4edc-a2f4-6ead2d899156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd271455-8b44-4edc-a2f4-6ead2d899156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1931050516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c994327e-e9de-4951-9817-54868fa6cf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:03Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74dfedb-fb2a-46cc-9e33-2b7c62903e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74dfedb-fb2a-46cc-9e33-2b7c62903e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2dfbae-e4a8-4817-a48e-54c5f1cfeb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2dfbae-e4a8-4817-a48e-54c5f1cfeb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c994327e-e9de-4951-9817-54868fa6cf97', 'volume_name': 'volume-c994327e-e9de-4951-9817-54868fa6cf97', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bfcbb69-dd2b-4943-86d9-380fbb45eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bfcbb69-dd2b-4943-86d9-380fbb45eb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b59d91-6b76-42ff-af61-805410f68ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Volume c994327e-e9de-4951-9817-54868fa6cf97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c994327e-e9de-4951-9817-54868fa6cf97', 'volume_size': 1} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1931050516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c994327e-e9de-4951-9817-54868fa6cf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:03Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Creating volume c994327e-e9de-4951-9817-54868fa6cf97 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:02 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:02 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 1073741824 Apr 29 18:13:02 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:03 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 1073741824" returned: 0 in 1.005s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:04 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 Apr 29 18:13:04 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (9abc4dfd-7af7-43c4-9d69-62a452218d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a0056c-f702-4b21-98cf-cd514c3930e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a0056c-f702-4b21-98cf-cd514c3930e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-334884461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cab2307-af45-43af-834e-90c77f9039e6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:04Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8bbd8-7960-41c6-9fd5-0ecd2774f815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8bbd8-7960-41c6-9fd5-0ecd2774f815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b51592-5ef1-4701-b9e8-4b59e4253be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b51592-5ef1-4701-b9e8-4b59e4253be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cab2307-af45-43af-834e-90c77f9039e6', 'volume_name': 'volume-6cab2307-af45-43af-834e-90c77f9039e6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec1b892-f308-45c6-81f5-1a8b6eb7be42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec1b892-f308-45c6-81f5-1a8b6eb7be42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f09829e-533f-4153-9995-f4ad13cb8637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:04 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Volume 6cab2307-af45-43af-834e-90c77f9039e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cab2307-af45-43af-834e-90c77f9039e6', 'volume_size': 1} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:04 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97" returned: 0 in 0.771s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-334884461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cab2307-af45-43af-834e-90c77f9039e6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:04Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Creating volume 6cab2307-af45-43af-834e-90c77f9039e6 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:04 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b59d91-6b76-42ff-af61-805410f68ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c994327e-e9de-4951-9817-54868fa6cf97', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:04 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 1073741824 Apr 29 18:13:04 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e409a7-3f48-4610-915c-bc05330c48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:04 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Volume volume-c994327e-e9de-4951-9817-54868fa6cf97 (c994327e-e9de-4951-9817-54868fa6cf97): created successfully Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e409a7-3f48-4610-915c-bc05330c48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (f7886126-be41-4b1d-8461-f5b487f38ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1a83623d-f65e-4f8a-93ba-a95668acea83 tempest-VolumesActionsTest-295501478 None] Created volume successfully. Apr 29 18:13:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-c994327e-e9de-4951-9817-54868fa6cf97-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-c994327e-e9de-4951-9817-54868fa6cf97-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "cinder-quobyte-c994327e-e9de-4951-9817-54868fa6cf97" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-c994327e-e9de-4951-9817-54868fa6cf97" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:05 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6e022c-0977-4ce0-903c-6110767102ad]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:05 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 Apr 29 18:13:05 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:06 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 1073741824" returned: 0 in 1.464s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:06 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 Apr 29 18:13:06 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Flow 'volume_create_manager' (4f2784dc-4ae4-4ac5-b262-9de3d991e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c823dc-c95c-4709-8286-7ccc70ee7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c823dc-c95c-4709-8286-7ccc70ee7af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1943715705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934e6d04-08e8-4a22-8a12-b553d5b02b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5bb0a9e264030b4fb607fcd3f4a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:06Z,use_quota=True,user_id='bcc8dee4e75b416e8206f76fba1299e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c527c7-1a0a-4775-a327-df24a4613b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c527c7-1a0a-4775-a327-df24a4613b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1a38af-3c4c-44b9-92f1-b09c8c37c967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1a38af-3c4c-44b9-92f1-b09c8c37c967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934e6d04-08e8-4a22-8a12-b553d5b02b74', 'volume_name': 'volume-934e6d04-08e8-4a22-8a12-b553d5b02b74', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fe187d-b72a-478a-bae8-18e74aada76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fe187d-b72a-478a-bae8-18e74aada76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86a8592-7e1c-4c62-bf22-d76682d02f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:06 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Volume 934e6d04-08e8-4a22-8a12-b553d5b02b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934e6d04-08e8-4a22-8a12-b553d5b02b74', 'volume_size': 1} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:06 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97" returned: 0 in 1.205s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:06 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97 Apr 29 18:13:06 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:07 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6" returned: 0 in 0.856s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.447s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1943715705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934e6d04-08e8-4a22-8a12-b553d5b02b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5bb0a9e264030b4fb607fcd3f4a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:06Z,use_quota=True,user_id='bcc8dee4e75b416e8206f76fba1299e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Creating volume 934e6d04-08e8-4a22-8a12-b553d5b02b74 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:07 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:07 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 1073741824 Apr 29 18:13:07 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f09829e-533f-4153-9995-f4ad13cb8637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cab2307-af45-43af-834e-90c77f9039e6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61758eec-5e5b-4f4b-b661-495b7b65c602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Volume volume-6cab2307-af45-43af-834e-90c77f9039e6 (6cab2307-af45-43af-834e-90c77f9039e6): created successfully Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61758eec-5e5b-4f4b-b661-495b7b65c602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (9abc4dfd-7af7-43c4-9d69-62a452218d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:07 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a9c82eba-4b9c-4caa-b6a1-0cddd9f60dee tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:13:07 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c994327e-e9de-4951-9817-54868fa6cf97" returned: 0 in 0.941s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-quobyte-c994327e-e9de-4951-9817-54868fa6cf97" released by "delete_volume" :: held 2.258s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Created reservations ['e7269b1e-cb95-4af2-bcb0-7c6c2ff5a72b', '5046ae5c-1bf7-41fa-9962-5a4d8cd316b7', '2e3d1511-4115-4af2-bab1-df236f541898', '65e80a47-6800-4192-aa40-9657fe8065b5'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:08 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:08 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:09 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 1073741824" returned: 0 in 1.854s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:09 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 Apr 29 18:13:09 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (6b5ea926-65d4-4a05-b80e-e21f0f944813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bed003-6b29-4793-b055-db0d09fac9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bed003-6b29-4793-b055-db0d09fac9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-466964163',display_name='tempest-VolumesGetTest-Volume-1400889410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443390c2-6049-478b-848f-213dafd6af45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:09Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cb4900-091c-4d6e-9bb1-8c935fa40b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cb4900-091c-4d6e-9bb1-8c935fa40b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b5fb60-7663-4071-8ea9-b1c78b1f6940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b5fb60-7663-4071-8ea9-b1c78b1f6940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443390c2-6049-478b-848f-213dafd6af45', 'volume_name': 'volume-443390c2-6049-478b-848f-213dafd6af45', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c1dc8c-019f-4957-81a1-843391d4b0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c1dc8c-019f-4957-81a1-843391d4b0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e49e0d4-94ee-4dd5-840b-74debe054e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:09 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Volume 443390c2-6049-478b-848f-213dafd6af45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443390c2-6049-478b-848f-213dafd6af45', 'volume_size': 1} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:09 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.424s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:09 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Deleted volume successfully. Apr 29 18:13:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b57c17bf-ca8d-400d-a2df-6db3fd2ca248 tempest-VolumesActionsTest-2134579970 None] Lock "cinder-c994327e-e9de-4951-9817-54868fa6cf97-delete_volume" released by "delete_volume" :: held 4.127s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (8316c5d1-4981-48ad-a638-8c80f5989612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb9a1c6-91e3-4dd0-a904-2cd104abea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb9a1c6-91e3-4dd0-a904-2cd104abea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-388451410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13e058c-29de-4bd8-848a-c53fa5211927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:10Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fbb645-2ed7-4dd7-ad65-3738d7956964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fbb645-2ed7-4dd7-ad65-3738d7956964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb412615-fe2d-4690-81a9-c86e5fbc7696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb412615-fe2d-4690-81a9-c86e5fbc7696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13e058c-29de-4bd8-848a-c53fa5211927', 'volume_name': 'volume-e13e058c-29de-4bd8-848a-c53fa5211927', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3ea30c-f516-436d-bbb6-163a6d4e341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3ea30c-f516-436d-bbb6-163a6d4e341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469cf043-61b1-4b42-8bd8-d78e393f221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Volume e13e058c-29de-4bd8-848a-c53fa5211927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13e058c-29de-4bd8-848a-c53fa5211927', 'volume_size': 1} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:10 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74" returned: 0 in 1.300s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] <== create_volume: return (3259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.267s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-466964163',display_name='tempest-VolumesGetTest-Volume-1400889410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443390c2-6049-478b-848f-213dafd6af45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:09Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Creating volume 443390c2-6049-478b-848f-213dafd6af45 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:10 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86a8592-7e1c-4c62-bf22-d76682d02f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934e6d04-08e8-4a22-8a12-b553d5b02b74', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a07bcb0-4207-44e0-95e2-fb1e023702e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:10 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 1073741824 Apr 29 18:13:10 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Volume volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 (934e6d04-08e8-4a22-8a12-b553d5b02b74): created successfully Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a07bcb0-4207-44e0-95e2-fb1e023702e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Flow 'volume_create_manager' (4f2784dc-4ae4-4ac5-b262-9de3d991e219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4281abb8-7256-405c-ac3f-ee41a5d79f0a tempest-VolumesMetadataTest-1004226986 None] Created volume successfully. Apr 29 18:13:11 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 1073741824" returned: 0 in 1.218s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:11 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:DELETE=8,cinder:SELECT=102,cinder:INSERT=34,cinder:UPDATE=124 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:13:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:11 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 Apr 29 18:13:11 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Acquiring lock "cinder-934e6d04-08e8-4a22-8a12-b553d5b02b74-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Lock "cinder-934e6d04-08e8-4a22-8a12-b553d5b02b74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Acquiring lock "cinder-quobyte-934e6d04-08e8-4a22-8a12-b553d5b02b74" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Lock "cinder-quobyte-934e6d04-08e8-4a22-8a12-b553d5b02b74" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc12ba-3b40-4594-9bb0-767436b723f9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:12 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 Apr 29 18:13:12 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:12 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45" returned: 0 in 1.099s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] <== create_volume: return (2380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.384s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.484s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-388451410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13e058c-29de-4bd8-848a-c53fa5211927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662d682aba864dbe860592001527e158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:10Z,use_quota=True,user_id='60f3aeec1b974caca01efa6f6a6a0d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Creating volume e13e058c-29de-4bd8-848a-c53fa5211927 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:12 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:12 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 1073741824 Apr 29 18:13:12 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e49e0d4-94ee-4dd5-840b-74debe054e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443390c2-6049-478b-848f-213dafd6af45', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4227cfc6-6f9f-41ee-a3f6-5d839118910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:12 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Volume volume-443390c2-6049-478b-848f-213dafd6af45 (443390c2-6049-478b-848f-213dafd6af45): created successfully Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4227cfc6-6f9f-41ee-a3f6-5d839118910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (6b5ea926-65d4-4a05-b80e-e21f0f944813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d8983005-3c39-4a3f-a7dd-3838f296095a tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:13:13 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74" returned: 0 in 0.942s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:13 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74 Apr 29 18:13:13 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-443390c2-6049-478b-848f-213dafd6af45-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Lock "cinder-443390c2-6049-478b-848f-213dafd6af45-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-443390c2-6049-478b-848f-213dafd6af45" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-443390c2-6049-478b-848f-213dafd6af45" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[195eb845-ba84-402a-89a5-a0622a9815fb]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:14 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 1073741824" returned: 0 in 1.128s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:14 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 Apr 29 18:13:14 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:14 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 Apr 29 18:13:14 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:14 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-934e6d04-08e8-4a22-8a12-b553d5b02b74" returned: 0 in 1.149s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Lock "cinder-quobyte-934e6d04-08e8-4a22-8a12-b553d5b02b74" released by "delete_volume" :: held 2.208s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Created reservations ['2e483bb3-f0b7-4187-b0a4-a6075bac40a6', '0258c2a5-89bf-4611-9b4f-6462fca92f95', '23ddd833-4583-46b9-83a5-e311730792bb', 'b0c32653-6cf9-45dc-b26a-397ecd531a1b'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:15 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:15 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:15 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927" returned: 0 in 1.233s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:15 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45" returned: 0 in 1.369s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469cf043-61b1-4b42-8bd8-d78e393f221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13e058c-29de-4bd8-848a-c53fa5211927', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:15 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45 Apr 29 18:13:15 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c831a2-eca0-4517-9f0c-357c3cbbec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:15 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Volume volume-e13e058c-29de-4bd8-848a-c53fa5211927 (e13e058c-29de-4bd8-848a-c53fa5211927): created successfully Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c831a2-eca0-4517-9f0c-357c3cbbec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Flow 'volume_create_manager' (8316c5d1-4981-48ad-a638-8c80f5989612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f5480e68-f463-4ba0-a487-95ee37d46c8a tempest-VolumesActionsTest-295501478 None] Created volume successfully. Apr 29 18:13:16 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-443390c2-6049-478b-848f-213dafd6af45" returned: 0 in 0.861s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:16 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-443390c2-6049-478b-848f-213dafd6af45" released by "delete_volume" :: held 2.315s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.242s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Deleted volume successfully. Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4da50696-9a0d-4ae3-b904-33012927b283 tempest-VolumesMetadataTest-1004226986 None] Lock "cinder-934e6d04-08e8-4a22-8a12-b553d5b02b74-delete_volume" released by "delete_volume" :: held 4.010s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Created reservations ['c79a3488-ba73-4c3b-bf51-2b86b7bb52a5', 'ddf65180-65a0-4ca9-bde9-6d4147cd4930', '4baa45e9-9aab-4221-b4ff-baef244f41fe', '1490e812-04ed-4388-bb55-303a91cd0450'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:16 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:16 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Acquiring lock "cinder-e13e058c-29de-4bd8-848a-c53fa5211927-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Lock "cinder-e13e058c-29de-4bd8-848a-c53fa5211927-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Acquiring lock "cinder-quobyte-e13e058c-29de-4bd8-848a-c53fa5211927" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Lock "cinder-quobyte-e13e058c-29de-4bd8-848a-c53fa5211927" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec367ed3-c1ef-4812-bb6c-9890c6ba44be]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:17 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 Apr 29 18:13:17 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:17 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.832s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-6cab2307-af45-43af-834e-90c77f9039e6-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Lock "cinder-6cab2307-af45-43af-834e-90c77f9039e6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f4924289-b9ca-49f7-8cea-981f6d03ffe0 tempest-VolumesGetTest-2132558532 None] Lock "cinder-443390c2-6049-478b-848f-213dafd6af45-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-6cab2307-af45-43af-834e-90c77f9039e6" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-6cab2307-af45-43af-834e-90c77f9039e6" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c680a94-7dee-4cbb-9595-90f7d313a215]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:17 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 Apr 29 18:13:17 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:18 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927" returned: 0 in 0.887s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:18 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927 Apr 29 18:13:18 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:18 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6" returned: 0 in 0.954s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:18 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6 Apr 29 18:13:18 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:18 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e13e058c-29de-4bd8-848a-c53fa5211927" returned: 0 in 0.787s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Lock "cinder-quobyte-e13e058c-29de-4bd8-848a-c53fa5211927" released by "delete_volume" :: held 1.729s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Created reservations ['3ee9d9ea-abb8-40ca-9b56-c2ec4a1f5c5b', 'f214086c-d1b4-4754-b902-06036c1b708a', '33832c9d-d9f1-4c52-aec1-6e54daaa3739', '203b2e6c-eb8e-4f6c-8ef8-6efdae475a50'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:19 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:19 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:19 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6cab2307-af45-43af-834e-90c77f9039e6" returned: 0 in 0.686s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-6cab2307-af45-43af-834e-90c77f9039e6" released by "delete_volume" :: held 1.697s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-d5e1bb07-9309-468c-9c03-8fbcc4828338 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Terminate volume connection completed successfully. Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-d5e1bb07-9309-468c-9c03-8fbcc4828338 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Deleting attachment 79571839-1ac9-45b9-886d-2b3d0b784c0a. {{(pid=84402) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Created reservations ['6c887784-5bf8-494b-89fe-f9f6c26d025b', 'e10568a9-7c4c-4831-968e-2a84990ab6e1', '9b0b6149-d6d9-414c-af83-9774acc97344', '30899fb4-a3ab-4224-b0a1-71df5d1402d1'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:19 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:19 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:19 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.749s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Deleted volume successfully. Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6df77edd-6aa6-4ef5-85c1-e01eefb84a95 tempest-VolumesActionsTest-295501478 None] Lock "cinder-e13e058c-29de-4bd8-848a-c53fa5211927-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "cinder-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "cinder-quobyte-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-quobyte-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" acquired by "delete_volume" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78d0ce4-c1fa-470e-9842-48704bdf50b6]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:20 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:13:20 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:20 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.129s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (c8dc7dac-1a47-4ebe-a76b-ddded6ed1dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2023d11e-9db5-4b1a-8e3f-2536b4c5d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2023d11e-9db5-4b1a-8e3f-2536b4c5d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-93211997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c19d55-8162-4651-a6e8-b8a837143c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:20Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca73cb1-2c8e-4e62-a9a1-6e517c051ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca73cb1-2c8e-4e62-a9a1-6e517c051ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9f2fc3-404e-492b-a718-869f597d5b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9f2fc3-404e-492b-a718-869f597d5b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c19d55-8162-4651-a6e8-b8a837143c0a', 'volume_name': 'volume-12c19d55-8162-4651-a6e8-b8a837143c0a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3904d2b8-7c96-4422-98f4-8cf3018cff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3904d2b8-7c96-4422-98f4-8cf3018cff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed1f27b-72fd-45bb-9630-78c1fc62390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:20 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Volume 12c19d55-8162-4651-a6e8-b8a837143c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c19d55-8162-4651-a6e8-b8a837143c0a', 'volume_size': 1} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-93211997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c19d55-8162-4651-a6e8-b8a837143c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:20Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Creating volume 12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:20 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23d9bf04-971e-427f-b331-382c8412cd35 tempest-VolumesGetTest-2132558532 None] Lock "cinder-6cab2307-af45-43af-834e-90c77f9039e6-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:20 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a 1073741824 Apr 29 18:13:20 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:21 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 0 in 1.143s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:21 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:13:21 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:21 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a 1073741824" returned: 0 in 0.995s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:21 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:21 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:22 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 1 in 0.825s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:22 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c Apr 29 18:13:22 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:22 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.930s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed1f27b-72fd-45bb-9630-78c1fc62390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c19d55-8162-4651-a6e8-b8a837143c0a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112c5f26-f1e9-4a3a-b71e-a982c2312dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Volume volume-12c19d55-8162-4651-a6e8-b8a837143c0a (12c19d55-8162-4651-a6e8-b8a837143c0a): created successfully Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112c5f26-f1e9-4a3a-b71e-a982c2312dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (c8dc7dac-1a47-4ebe-a76b-ddded6ed1dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7c83aab2-88af-49cf-81f8-0a34be2d0186 tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:13:22 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" returned: 0 in 0.756s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-quobyte-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c" released by "delete_volume" :: held 2.830s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:22 devstack cinder-volume[84402]: DEBUG cinder.quota [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Created reservations ['20bcdeea-9f2a-43d4-b621-c719aee64925', '629f07e3-ba5e-48e3-a47d-c8db9948d55d', 'b7be70df-8e54-4ff4-b04e-be9a84be40df', 'e1c2dfec-e4da-4794-9c8a-8722cb4f9282'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:23 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:23 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:23 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.668s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG cinder.manager [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Deleted volume successfully. Apr 29 18:13:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-91d9dad9-9f7b-4a46-b1fe-80d77ce19149 req-ed5bfe28-40c9-4b8c-875d-6d8048108eaf tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-8225bdc0-b0d8-4971-b42b-a5c4d87dfb5c-delete_volume" released by "delete_volume" :: held 3.864s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (d88d704a-2f61-4a04-9326-a5116ec67a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea8dc94-1c1a-4c76-b895-b0ea8ae6fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea8dc94-1c1a-4c76-b895-b0ea8ae6fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1255047311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4342725c-4269-4f18-b442-db71293207cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=12c19d55-8162-4651-a6e8-b8a837143c0a,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:24Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d98ca05-0b93-43f8-b92b-c9531cccd0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d98ca05-0b93-43f8-b92b-c9531cccd0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a9b56-3fd7-4721-a620-0ed9fe1fedb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a9b56-3fd7-4721-a620-0ed9fe1fedb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4342725c-4269-4f18-b442-db71293207cd', 'volume_name': 'volume-4342725c-4269-4f18-b442-db71293207cd', 'volume_size': 1, 'source_volid': '12c19d55-8162-4651-a6e8-b8a837143c0a', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f7e350-13da-4059-a397-33c9f9ea199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f7e350-13da-4059-a397-33c9f9ea199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d2486c-b7be-4944-96c0-19169fc4c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Volume 4342725c-4269-4f18-b442-db71293207cd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4342725c-4269-4f18-b442-db71293207cd', 'volume_size': 1, 'source_volid': '12c19d55-8162-4651-a6e8-b8a837143c0a', 'source_volstatus': 'available'} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:24 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Cloning volume 12c19d55-8162-4651-a6e8-b8a837143c0a to volume 4342725c-4269-4f18-b442-db71293207cd Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Creating offline snapshot 408f6159-d3dc-459c-bf08-b3cefdfa82cd of volume 12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a6afa-3319-43b4-b9b6-06d104faf3db]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:24 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:24 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:25 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.758s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:25 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd 1G Apr 29 18:13:25 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:26 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd 1G" returned: 0 in 1.012s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c19d55-8162-4651-a6e8-b8a837143c0a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:26 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c19d55-8162-4651-a6e8-b8a837143c0a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd Apr 29 18:13:26 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:27 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c19d55-8162-4651-a6e8-b8a837143c0a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd" returned: 0 in 0.726s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:27 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd is being set with open permissions: ugo+rw Apr 29 18:13:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:27 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd Apr 29 18:13:27 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:27 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd" returned: 0 in 0.763s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:27 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info Apr 29 18:13:27 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:28 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info" returned: 0 in 0.669s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:28 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info is being set with open permissions: ugo+rw Apr 29 18:13:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:28 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info Apr 29 18:13:28 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:29 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.info" returned: 0 in 0.634s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-4342725c-4269-4f18-b442-db71293207cd" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-4342725c-4269-4f18-b442-db71293207cd" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] snapshot: 408f6159-d3dc-459c-bf08-b3cefdfa82cd, volume: 4342725c-4269-4f18-b442-db71293207cd, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355cbba-6164-4f0b-bfef-f8f69b2f2bd5]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:29 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd Apr 29 18:13:29 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:30 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd" returned: 0 in 1.226s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c19d55-8162-4651-a6e8-b8a837143c0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf0a26-afd6-4d16-b09f-9af48f0b368a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:30 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:30 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (92216df5-bcac-45ba-8562-58f682dbdefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179d90ef-dc68-4836-99c4-dd3fecf34139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179d90ef-dc68-4836-99c4-dd3fecf34139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570770473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aaed85b-1588-455b-a0da-89faf6a77176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:31Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16428ec5-e485-46c5-8d34-fd975db80431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16428ec5-e485-46c5-8d34-fd975db80431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f707009-4d4f-477c-a04f-8be9c2f064d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f707009-4d4f-477c-a04f-8be9c2f064d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aaed85b-1588-455b-a0da-89faf6a77176', 'volume_name': 'volume-7aaed85b-1588-455b-a0da-89faf6a77176', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96612aa-4459-4685-9635-87ddada67dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96612aa-4459-4685-9635-87ddada67dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8776d843-1ed9-4399-886d-760fffa0deb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Volume 7aaed85b-1588-455b-a0da-89faf6a77176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aaed85b-1588-455b-a0da-89faf6a77176', 'volume_size': 1} Apr 29 18:13:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:31 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.794s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:31 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:13:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:31 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd Apr 29 18:13:31 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:35 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:35 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:37 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.321s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:37 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:37 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd" returned: 0 in 6.569s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:37 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd23bdcb-0b88-4e16-8189-579cc2a06136]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:38 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:38 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:38 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.942s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:38 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:13:38 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Converted 1024.00 MB image at 155.85 MB/s Apr 29 18:13:38 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd is being set with open permissions: ugo+rw Apr 29 18:13:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:38 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd Apr 29 18:13:38 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=135,cinder:SELECT=111,cinder:INSERT=42,cinder:DELETE=11 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:13:39 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6c7c44d7-6d91-4b92-bb96-3cc369680dc6 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Terminate volume connection completed successfully. Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6c7c44d7-6d91-4b92-bb96-3cc369680dc6 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Deleting attachment 68c81f05-d23b-49fe-a874-6408bdf880de. {{(pid=84402) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 18:13:39 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd" returned: 0 in 0.602s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-4342725c-4269-4f18-b442-db71293207cd" released by "_copy_volume_from_snapshot" :: held 10.260s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-408f6159-d3dc-459c-bf08-b3cefdfa82cd" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-408f6159-d3dc-459c-bf08-b3cefdfa82cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Deleting offline snapshot 408f6159-d3dc-459c-bf08-b3cefdfa82cd of volume 12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] snapshot_file for this snap is: volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70c586-8311-454c-a589-3c5ceaa84435]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:39 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd Apr 29 18:13:39 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "cinder-d863c227-2e03-46ae-939e-44346057be7e-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-d863c227-2e03-46ae-939e-44346057be7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "cinder-quobyte-d863c227-2e03-46ae-939e-44346057be7e" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-quobyte-d863c227-2e03-46ae-939e-44346057be7e" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[513ff9e1-e6df-4cb0-81a4-d972107f0681]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:40 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e Apr 29 18:13:40 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:40 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd" returned: 0 in 0.792s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c19d55-8162-4651-a6e8-b8a837143c0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8646ded-b8f3-43cf-93e1-384e4d67f16a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:40 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:40 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:40 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e" returned: 0 in 0.807s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:41 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e Apr 29 18:13:41 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:41 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.800s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:41 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd Apr 29 18:13:41 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Flow 'volume_create_manager' (e6b4648d-9e69-4814-b4a4-c23b9db784c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3352c42-3559-45ef-a3c3-1356865f6822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3352c42-3559-45ef-a3c3-1356865f6822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585898524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b07dea-3d2c-46e8-9e10-5bba6d94146e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b62155d972421990fbb14e7402deb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:41Z,use_quota=True,user_id='d310fdd539324534b1d9af5291890a93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d5e2ff-3375-41eb-8862-ce52ed669500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d5e2ff-3375-41eb-8862-ce52ed669500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a8682a-58ad-444c-8305-1f32a5543ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a8682a-58ad-444c-8305-1f32a5543ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b07dea-3d2c-46e8-9e10-5bba6d94146e', 'volume_name': 'volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f9596-d19c-4aaf-95f1-ae0d7316c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f9596-d19c-4aaf-95f1-ae0d7316c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cf22db-3182-479d-99c2-61e7b33165de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Volume c5b07dea-3d2c-46e8-9e10-5bba6d94146e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e', 'volume_size': 1} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:41 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d863c227-2e03-46ae-939e-44346057be7e" returned: 0 in 0.717s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-quobyte-d863c227-2e03-46ae-939e-44346057be7e" released by "delete_volume" :: held 1.573s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.quota [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Created reservations ['9ba9c69e-2de9-4580-8530-c9607248424b', '3bea50ea-668d-4394-8c72-e94edde3d4ff', '15ebbdc1-2265-4e6e-9c90-3f9e0f35acb4', 'e14073a6-c021-4978-80d9-5a559adeffaa'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:41 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:41 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:41 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd" returned: 0 in 0.784s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:42 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd Apr 29 18:13:42 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:42 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.678s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.manager [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Deleted volume successfully. Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [req-12b504b3-c9f6-4aae-a795-ecfb92caea75 req-6256bf37-8ab4-4415-af24-c2851ae28471 tempest-ServerBootFromVolumeStableRescueTest-419246483 None] Lock "cinder-d863c227-2e03-46ae-939e-44346057be7e-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:42 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a.408f6159-d3dc-459c-bf08-b3cefdfa82cd" returned: 0 in 0.654s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-408f6159-d3dc-459c-bf08-b3cefdfa82cd" released by "_delete_snapshot" :: held 3.123s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.179s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.705s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570770473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aaed85b-1588-455b-a0da-89faf6a77176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:31Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Creating volume 7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:42 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d2486c-b7be-4944-96c0-19169fc4c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4342725c-4269-4f18-b442-db71293207cd', 'volume_size': 1, 'source_volid': '12c19d55-8162-4651-a6e8-b8a837143c0a', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:42 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 1073741824 Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d907954-6e70-4026-b2e3-76150ecdfab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:42 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Volume volume-4342725c-4269-4f18-b442-db71293207cd (4342725c-4269-4f18-b442-db71293207cd): created successfully Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d907954-6e70-4026-b2e3-76150ecdfab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (d88d704a-2f61-4a04-9326-a5116ec67a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a8210b60-8c45-4a3e-ad15-783508c8db82 tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:13:43 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 1073741824" returned: 0 in 0.910s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:43 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 Apr 29 18:13:43 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (9669ed1e-39ed-4ffb-ad1c-419da1df6360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3454724c-7057-401b-91ed-ee54c10eb217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3454724c-7057-401b-91ed-ee54c10eb217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2035124057',display_name='tempest-VolumesGetTest-Volume-1888763692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e132fd30-d3da-47a8-aa0a-4b40e2392807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:44Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c545d763-f10c-43b1-acde-c337b22f1d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c545d763-f10c-43b1-acde-c337b22f1d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1aef993-779f-4ad2-b803-305fe3f775c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1aef993-779f-4ad2-b803-305fe3f775c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e132fd30-d3da-47a8-aa0a-4b40e2392807', 'volume_name': 'volume-e132fd30-d3da-47a8-aa0a-4b40e2392807', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eae20c-d8bf-45bd-b312-c7efd23a6bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eae20c-d8bf-45bd-b312-c7efd23a6bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9ac153-17cf-4590-9a74-5b9f624959e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:44 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Volume e132fd30-d3da-47a8-aa0a-4b40e2392807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e132fd30-d3da-47a8-aa0a-4b40e2392807', 'volume_size': 1} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:44 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176" returned: 0 in 0.672s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.924s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585898524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b07dea-3d2c-46e8-9e10-5bba6d94146e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b62155d972421990fbb14e7402deb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:41Z,use_quota=True,user_id='d310fdd539324534b1d9af5291890a93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Creating volume c5b07dea-3d2c-46e8-9e10-5bba6d94146e {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:44 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8776d843-1ed9-4399-886d-760fffa0deb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aaed85b-1588-455b-a0da-89faf6a77176', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:44 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e 1073741824 Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1057f25f-26c6-4f2b-9b1d-399326583239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:44 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:44 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Volume volume-7aaed85b-1588-455b-a0da-89faf6a77176 (7aaed85b-1588-455b-a0da-89faf6a77176): created successfully Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1057f25f-26c6-4f2b-9b1d-399326583239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (92216df5-bcac-45ba-8562-58f682dbdefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4a29631d-5ac2-437e-bb30-be4d8cf5b051 tempest-VolumesSnapshotTestJSON-1557404375 None] Created volume successfully. Apr 29 18:13:45 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e 1073741824" returned: 0 in 0.945s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:45 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e Apr 29 18:13:45 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:45 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e" returned: 0 in 0.666s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.862s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2035124057',display_name='tempest-VolumesGetTest-Volume-1888763692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e132fd30-d3da-47a8-aa0a-4b40e2392807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:44Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Creating volume e132fd30-d3da-47a8-aa0a-4b40e2392807 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:46 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cf22db-3182-479d-99c2-61e7b33165de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:46 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 1073741824 Apr 29 18:13:46 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc1e6a2-2d15-453b-a403-a2222fc7482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Volume volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e (c5b07dea-3d2c-46e8-9e10-5bba6d94146e): created successfully Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc1e6a2-2d15-453b-a403-a2222fc7482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Flow 'volume_create_manager' (e6b4648d-9e69-4814-b4a4-c23b9db784c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-6979377d-a2bb-4085-a843-1777dd547a9b tempest-VolumesListAdminTestJSON-1866457516 None] Created volume successfully. Apr 29 18:13:46 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 1073741824" returned: 0 in 0.943s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:47 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 Apr 29 18:13:47 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Flow 'volume_create_manager' (df11add4-ae32-429b-a1bf-9d813ce8325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d922e9-290c-4921-ae4d-9bcf391ff879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d922e9-290c-4921-ae4d-9bcf391ff879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1991501959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7c0436-fa39-4661-9a1a-b9b100655a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b62155d972421990fbb14e7402deb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:47Z,use_quota=True,user_id='d310fdd539324534b1d9af5291890a93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2c49fd-6a9b-4617-9975-48a9a1b915b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2c49fd-6a9b-4617-9975-48a9a1b915b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99559c6b-894c-409b-b616-a936e40bb637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99559c6b-894c-409b-b616-a936e40bb637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7c0436-fa39-4661-9a1a-b9b100655a51', 'volume_name': 'volume-dc7c0436-fa39-4661-9a1a-b9b100655a51', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcad2ebd-6678-4744-bb35-640f52d9a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcad2ebd-6678-4744-bb35-640f52d9a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9bef0a-5022-4a30-8b05-5322fdbf8e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:47 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Volume dc7c0436-fa39-4661-9a1a-b9b100655a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7c0436-fa39-4661-9a1a-b9b100655a51', 'volume_size': 1} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:47 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807" returned: 0 in 0.614s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.874s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9ac153-17cf-4590-9a74-5b9f624959e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e132fd30-d3da-47a8-aa0a-4b40e2392807', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1511f-5759-43fd-ab95-752e678b2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Creating offline snapshot 80dcfa00-a4af-4d65-8096-3f3739c788db of volume 7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:13:47 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Volume volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 (e132fd30-d3da-47a8-aa0a-4b40e2392807): created successfully Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1511f-5759-43fd-ab95-752e678b2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (9669ed1e-39ed-4ffb-ad1c-419da1df6360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a53fd9-6fe6-4044-9d7f-b426d7ed1b83]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2a0c01ad-457d-4264-88d1-b7f807ea358a tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:13:47 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 Apr 29 18:13:47 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:48 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176" returned: 0 in 0.756s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:48 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db 1G Apr 29 18:13:48 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-e132fd30-d3da-47a8-aa0a-4b40e2392807-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Lock "cinder-e132fd30-d3da-47a8-aa0a-4b40e2392807-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-e132fd30-d3da-47a8-aa0a-4b40e2392807" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-e132fd30-d3da-47a8-aa0a-4b40e2392807" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0392d0a-e0db-4960-a8c8-53f1706ea6c1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:48 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 Apr 29 18:13:48 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:49 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db 1G" returned: 0 in 0.823s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aaed85b-1588-455b-a0da-89faf6a77176 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:49 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aaed85b-1588-455b-a0da-89faf6a77176 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db Apr 29 18:13:49 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:49 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807" returned: 0 in 0.783s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:49 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807 Apr 29 18:13:49 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:49 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aaed85b-1588-455b-a0da-89faf6a77176 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db" returned: 0 in 0.689s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:49 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db is being set with open permissions: ugo+rw Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:49 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db Apr 29 18:13:49 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:49 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e132fd30-d3da-47a8-aa0a-4b40e2392807" returned: 0 in 0.613s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-e132fd30-d3da-47a8-aa0a-4b40e2392807" released by "delete_volume" :: held 1.444s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Created reservations ['9df4a199-a3c5-4e7c-8ed6-9f4047b1eecc', '5bc1066b-65c4-429b-951c-6a926f476890', '784d0966-714d-49ee-aad3-ea472e428d7f', '753c7aa3-a4ec-409f-af59-7449669b351c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:50 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:50 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:50 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db" returned: 0 in 0.619s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:50 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info Apr 29 18:13:50 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:50 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.672s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:50 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-4342725c-4269-4f18-b442-db71293207cd-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72d4c2ec-abe5-44f1-a442-d8aedacbd84d tempest-VolumesGetTest-2132558532 None] Lock "cinder-e132fd30-d3da-47a8-aa0a-4b40e2392807-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Lock "cinder-4342725c-4269-4f18-b442-db71293207cd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-4342725c-4269-4f18-b442-db71293207cd" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-4342725c-4269-4f18-b442-db71293207cd" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e1f98-6317-4802-8d34-1828cc014696]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:51 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd Apr 29 18:13:51 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:51 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info" returned: 0 in 0.703s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:51 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info is being set with open permissions: ugo+rw Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:51 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info Apr 29 18:13:51 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:51 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd" returned: 0 in 0.762s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:51 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd Apr 29 18:13:51 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:51 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.info" returned: 0 in 0.653s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.716s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1991501959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7c0436-fa39-4661-9a1a-b9b100655a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b62155d972421990fbb14e7402deb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:47Z,use_quota=True,user_id='d310fdd539324534b1d9af5291890a93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Creating volume dc7c0436-fa39-4661-9a1a-b9b100655a51 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:52 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:52 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 1073741824 Apr 29 18:13:52 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4d406692-6079-491f-add8-e3a3993fc26c tempest-VolumesSnapshotTestJSON-1557404375 None] Create snapshot completed successfully Apr 29 18:13:52 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4342725c-4269-4f18-b442-db71293207cd" returned: 0 in 0.648s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-4342725c-4269-4f18-b442-db71293207cd" released by "delete_volume" :: held 1.460s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Created reservations ['90ee89ad-f2b6-4248-833a-ec82a1e4cde5', '9e214856-7b50-416a-90eb-c35e23efd446', '4f8403cb-e098-42f9-94a9-9f4f7422b6dd', 'e04a9f7a-1275-417e-b183-768601056de7'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:52 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:52 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:52 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 1073741824" returned: 0 in 0.853s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:52 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 Apr 29 18:13:52 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-12c19d55-8162-4651-a6e8-b8a837143c0a-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-80dcfa00-a4af-4d65-8096-3f3739c788db-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Lock "cinder-12c19d55-8162-4651-a6e8-b8a837143c0a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-80dcfa00-a4af-4d65-8096-3f3739c788db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-12c19d55-8162-4651-a6e8-b8a837143c0a" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-12c19d55-8162-4651-a6e8-b8a837143c0a" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-7aaed85b-1588-455b-a0da-89faf6a77176" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae982e-89ff-437d-90fe-aa648011c7e4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:53 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-7aaed85b-1588-455b-a0da-89faf6a77176" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-80dcfa00-a4af-4d65-8096-3f3739c788db" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.865s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-80dcfa00-a4af-4d65-8096-3f3739c788db" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Deleting offline snapshot 80dcfa00-a4af-4d65-8096-3f3739c788db of volume 7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] snapshot_file for this snap is: volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2ccfd81c-6f11-4aee-8c8d-606372edc279 tempest-VolumesGetTest-2132558532 None] Lock "cinder-4342725c-4269-4f18-b442-db71293207cd-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0702e3-3026-4f86-9cf3-5d24c6cf13ec]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:53 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:53 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:53 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db Apr 29 18:13:53 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:53 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51" returned: 0 in 0.901s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9bef0a-5022-4a30-8b05-5322fdbf8e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7c0436-fa39-4661-9a1a-b9b100655a51', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa7fe92-f2f2-40b4-b9ec-4898d031a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:53 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Volume volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 (dc7c0436-fa39-4661-9a1a-b9b100655a51): created successfully Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa7fe92-f2f2-40b4-b9ec-4898d031a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Flow 'volume_create_manager' (df11add4-ae32-429b-a1bf-9d813ce8325b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-6ea720c1-825e-43a2-954c-07b1ed99f7b4 tempest-VolumesListAdminTestJSON-1866457516 None] Created volume successfully. Apr 29 18:13:54 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.879s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:54 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a Apr 29 18:13:54 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:54 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db" returned: 0 in 0.881s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aaed85b-1588-455b-a0da-89faf6a77176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:13:54 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[953eae03-6fbe-415f-a2a9-a936efc4ea51]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:54 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 Apr 29 18:13:54 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:55 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-12c19d55-8162-4651-a6e8-b8a837143c0a" returned: 0 in 0.755s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-12c19d55-8162-4651-a6e8-b8a837143c0a" released by "delete_volume" :: held 1.741s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Created reservations ['9a7994d6-289d-4b3f-9fe1-ef09e98c19c2', 'ddeb51fb-ed1f-46c5-9fac-25ac4b14b2e3', 'abfe17cf-8445-4e86-9718-44eb6854e54a', '6cdb8b59-6998-4482-8186-6b14e90b906f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Flow 'volume_create_manager' (b35a8dc3-98ce-4366-baa6-73b0f293187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb4bcfa-fec2-48e4-b25a-bcb35ecc3e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:55 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:13:55 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb4bcfa-fec2-48e4-b25a-bcb35ecc3e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1039968674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c118114-3967-413f-b73b-bff040dc7ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b62155d972421990fbb14e7402deb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:55Z,use_quota=True,user_id='d310fdd539324534b1d9af5291890a93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93208ca-6742-44bd-842b-58f277784fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93208ca-6742-44bd-842b-58f277784fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbc1b6c-3fd4-4c4b-89cc-249acd778fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbc1b6c-3fd4-4c4b-89cc-249acd778fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c118114-3967-413f-b73b-bff040dc7ca6', 'volume_name': 'volume-6c118114-3967-413f-b73b-bff040dc7ca6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bb9088-d699-4cd0-8371-5809638273ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:55 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bb9088-d699-4cd0-8371-5809638273ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a351f86-a93b-4a2d-9252-bfaed84d38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:55 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Volume 6c118114-3967-413f-b73b-bff040dc7ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c118114-3967-413f-b73b-bff040dc7ca6', 'volume_size': 1} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1039968674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c118114-3967-413f-b73b-bff040dc7ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b62155d972421990fbb14e7402deb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:55Z,use_quota=True,user_id='d310fdd539324534b1d9af5291890a93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Creating volume 6c118114-3967-413f-b73b-bff040dc7ca6 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:55 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176" returned: 0 in 1.084s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:55 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 1073741824 Apr 29 18:13:55 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:55 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db Apr 29 18:13:55 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:56 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.853s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:13:56 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-354e2eda-4771-4375-976e-7d9fe96b97d5 tempest-VolumesGetTest-2132558532 None] Lock "cinder-12c19d55-8162-4651-a6e8-b8a837143c0a-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (a7f15d3b-b31d-4439-b3a1-9c4d01dd19bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece675bb-3a79-4de1-8259-c812a08f1130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece675bb-3a79-4de1-8259-c812a08f1130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1449461913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bbd851-50a6-4434-aaf8-8e1aa1065f2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:56Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e24f82e-2129-401f-a35b-7a3b03dd4085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e24f82e-2129-401f-a35b-7a3b03dd4085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139342a6-c8bc-4cb0-9ed5-196fbcd765b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG cinder.image.glance [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Creating Keystone auth plugin from conf {{(pid=84402) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 18:13:56 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db" returned: 0 in 1.071s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:56 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 1073741824" returned: 0 in 1.146s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:56 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db Apr 29 18:13:56 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:56 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 Apr 29 18:13:56 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139342a6-c8bc-4cb0-9ed5-196fbcd765b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9bbd851-50a6-4434-aaf8-8e1aa1065f2f', 'volume_name': 'volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c5182a-1cbf-47ec-a7f3-22762231bf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c5182a-1cbf-47ec-a7f3-22762231bf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fb1b05-9961-4f85-9d4c-a601828304ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Volume e9bbd851-50a6-4434-aaf8-8e1aa1065f2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Trying to clone e9bbd851-50a6-4434-aaf8-8e1aa1065f2f from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]). {{(pid=84402) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 18:13:57 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176.80dcfa00-a4af-4d65-8096-3f3739c788db" returned: 0 in 0.710s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-80dcfa00-a4af-4d65-8096-3f3739c788db" released by "_delete_snapshot" :: held 3.941s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-7aaed85b-1588-455b-a0da-89faf6a77176" released by "delete_snapshot" :: held 4.002s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:57 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6" returned: 0 in 0.755s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a351f86-a93b-4a2d-9252-bfaed84d38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c118114-3967-413f-b73b-bff040dc7ca6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f976bc9-78b7-4af3-8c2f-59565aa7ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Volume volume-6c118114-3967-413f-b73b-bff040dc7ca6 (6c118114-3967-413f-b73b-bff040dc7ca6): created successfully Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f976bc9-78b7-4af3-8c2f-59565aa7ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Flow 'volume_create_manager' (b35a8dc3-98ce-4366-baa6-73b0f293187d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c0bd37ad-ec71-4481-9b79-bfe40588afbc tempest-VolumesListAdminTestJSON-1866457516 None] Created volume successfully. Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['3aecd000-ca73-4033-ac15-541791cb3136', 'ca6b5a3a-6e7a-4b06-9fc5-93f526aa465a', 'ace8634c-47ae-401b-9aa9-d2dff1b896e0', 'ff3e1407-e9f3-4705-874b-a7837bba0269'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 18:13:57 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Image download 20.69 MB at 20.69 MB/s Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2a352-c40d-4285-a058-4e9f99b42326]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Delete snapshot completed successfully. Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-277f3333-a91c-4b2f-ad55-78fb2a96175c tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-80dcfa00-a4af-4d65-8096-3f3739c788db-delete_snapshot" released by "delete_snapshot" :: held 4.452s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:13:57 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD Apr 29 18:13:57 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Flow 'volume_create_manager' (54d8f794-b26e-4525-84b5-7532440c9af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c159d78f-1b69-452b-a77e-cbf5c8155da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c159d78f-1b69-452b-a77e-cbf5c8155da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-487504549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f20c98-2ffa-4c86-a180-3bbaa957b5be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1faee2f1a4546af2f71a507db4235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:58Z,use_quota=True,user_id='a35de939a1c24e9ea22adb70e40b6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6345a982-f213-4b5f-a6de-de9ad2cc2ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6345a982-f213-4b5f-a6de-de9ad2cc2ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9916afe2-3128-4832-91b2-64199d2be898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9916afe2-3128-4832-91b2-64199d2be898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f20c98-2ffa-4c86-a180-3bbaa957b5be', 'volume_name': 'volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d329bbd4-649f-45a7-99f0-0d9c972de56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d329bbd4-649f-45a7-99f0-0d9c972de56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ecf29c-c03c-4870-8242-00d55614f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:58 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Volume f3f20c98-2ffa-4c86-a180-3bbaa957b5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be', 'volume_size': 1} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-487504549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f20c98-2ffa-4c86-a180-3bbaa957b5be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1faee2f1a4546af2f71a507db4235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:58Z,use_quota=True,user_id='a35de939a1c24e9ea22adb70e40b6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Creating volume f3f20c98-2ffa-4c86-a180-3bbaa957b5be {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:58 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:58 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be 1073741824 Apr 29 18:13:58 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:58 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 is fetched for user 78cbf2e25f1f40e58825ccb6e6bb1ef4. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[47769b46-407a-49a1-bb3e-02d4477201bd]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:58 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD Apr 29 18:13:58 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:58 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be 1073741824" returned: 0 in 0.899s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:59 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be Apr 29 18:13:59 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (ddb33145-54d0-4141-bdae-624bf09673b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4525c90c-e5c7-4301-a585-0f20c2626b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4525c90c-e5c7-4301-a585-0f20c2626b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605596979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d0cf16-6637-419b-87aa-f19400b5b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:59Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b09c5a-a9c8-4cbe-882c-3d477ff5bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b09c5a-a9c8-4cbe-882c-3d477ff5bad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f407b8c-0568-4b8b-af87-8f25c4b5cda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f407b8c-0568-4b8b-af87-8f25c4b5cda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d0cf16-6637-419b-87aa-f19400b5b733', 'volume_name': 'volume-67d0cf16-6637-419b-87aa-f19400b5b733', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db737e5-a173-4d4c-9dee-7774035a42f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db737e5-a173-4d4c-9dee-7774035a42f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28cd7aa-d89e-4f07-ac88-b3e39187a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Volume 67d0cf16-6637-419b-87aa-f19400b5b733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d0cf16-6637-419b-87aa-f19400b5b733', 'volume_size': 1} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Flow 'volume_create_manager' (04b150d5-a7b7-408f-82d6-3a82971b85c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0388d0bf-79e7-4552-94d5-d899e3c4dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0388d0bf-79e7-4552-94d5-d899e3c4dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d6d8fb-23d9-4208-9a15-6ac4a4a60362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59463366c174f7dae06c66ab2f1b079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:59Z,use_quota=True,user_id='dc5a7b1614124ab78c73ad6626ab483c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4565c53e-3d6e-43ca-bc76-1188c17eeae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4565c53e-3d6e-43ca-bc76-1188c17eeae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a77f03-b43b-4d3c-80fb-670ef7e14688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a77f03-b43b-4d3c-80fb-670ef7e14688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d6d8fb-23d9-4208-9a15-6ac4a4a60362', 'volume_name': 'volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8615b1c6-d322-47b4-9715-2cdd43e1fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8615b1c6-d322-47b4-9715-2cdd43e1fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f834d33-8731-4fef-b92c-affaafdf0f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Volume b8d6d8fb-23d9-4208-9a15-6ac4a4a60362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362', 'volume_size': 1} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:59 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605596979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d0cf16-6637-419b-87aa-f19400b5b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:59Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Creating volume 67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:13:59 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:13:59 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 1073741824 Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ecf29c-c03c-4870-8242-00d55614f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503982fe-ab2f-49a4-8dc0-1662b0dab2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:13:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Volume volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be (f3f20c98-2ffa-4c86-a180-3bbaa957b5be): created successfully Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503982fe-ab2f-49a4-8dc0-1662b0dab2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:13:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Flow 'volume_create_manager' (54d8f794-b26e-4525-84b5-7532440c9af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:13:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f5c17865-d9ce-4552-a955-a8461b39374e tempest-VolumesTestJSON-248948481 None] Created volume successfully. Apr 29 18:14:00 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 1073741824" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:00 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:00 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Flow 'volume_create_manager' (88d381e1-1476-4583-a7a8-423dd3cb97ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df91956-e8f2-4d2b-9298-a196821ff986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df91956-e8f2-4d2b-9298-a196821ff986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-969374302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1faee2f1a4546af2f71a507db4235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:01Z,use_quota=True,user_id='a35de939a1c24e9ea22adb70e40b6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9a4c02-4a42-4d7b-a31f-e18ef381e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9a4c02-4a42-4d7b-a31f-e18ef381e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27471ee3-16c9-4912-a2b2-dace776789dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27471ee3-16c9-4912-a2b2-dace776789dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c', 'volume_name': 'volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5ea097-e7c1-4ce5-aded-c5844eac9dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5ea097-e7c1-4ce5-aded-c5844eac9dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de29138-bd46-4708-9c66-84bc3ea800df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:00 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Volume 6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c', 'volume_size': 1} Apr 29 18:14:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:01 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.611s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d6d8fb-23d9-4208-9a15-6ac4a4a60362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59463366c174f7dae06c66ab2f1b079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:59Z,use_quota=True,user_id='dc5a7b1614124ab78c73ad6626ab483c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Creating volume b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:01 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28cd7aa-d89e-4f07-ac88-b3e39187a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d0cf16-6637-419b-87aa-f19400b5b733', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113ace42-f0fb-471e-a24b-e7dbc86b462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:01 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 1073741824 Apr 29 18:14:01 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:01 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Volume volume-67d0cf16-6637-419b-87aa-f19400b5b733 (67d0cf16-6637-419b-87aa-f19400b5b733): created successfully Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113ace42-f0fb-471e-a24b-e7dbc86b462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (ddb33145-54d0-4141-bdae-624bf09673b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:01 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b4152725-cf93-409b-b861-26951ea39a6d tempest-VolumesSnapshotTestJSON-1557404375 None] Created volume successfully. Apr 29 18:14:01 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 1073741824" returned: 0 in 0.770s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:01 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 Apr 29 18:14:01 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:02 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362" returned: 0 in 0.637s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.093s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1449461913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bbd851-50a6-4434-aaf8-8e1aa1065f2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:13:56Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Creating volume e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:02 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:02 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f 1073741824 Apr 29 18:14:02 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f834d33-8731-4fef-b92c-affaafdf0f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20da77f5-7b98-4663-b75a-e4a3be3a5e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Volume volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 (b8d6d8fb-23d9-4208-9a15-6ac4a4a60362): created successfully Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20da77f5-7b98-4663-b75a-e4a3be3a5e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Flow 'volume_create_manager' (04b150d5-a7b7-408f-82d6-3a82971b85c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d87af732-8998-43ce-905b-e0bea3b8fc09 tempest-VolumesListAdminTestJSON-866907007 None] Created volume successfully. Apr 29 18:14:03 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f 1073741824" returned: 0 in 0.822s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:03 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:03 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Acquiring lock "cinder-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Lock "cinder-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Acquiring lock "cinder-quobyte-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Lock "cinder-quobyte-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5806b505-5e1d-4f4e-a9cc-6657854953c9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "cinder-6c118114-3967-413f-b73b-bff040dc7ca6-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-6c118114-3967-413f-b73b-bff040dc7ca6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "cinder-quobyte-6c118114-3967-413f-b73b-bff040dc7ca6" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:03 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 Apr 29 18:14:03 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-quobyte-6c118114-3967-413f-b73b-bff040dc7ca6" acquired by "delete_volume" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[15083d9e-f07e-482d-85f8-2b54b38e672f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:04 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 0 in 0.680s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.417s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-969374302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1faee2f1a4546af2f71a507db4235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:01Z,use_quota=True,user_id='a35de939a1c24e9ea22adb70e40b6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Creating volume 6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:04 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:04 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c 1073741824 Apr 29 18:14:04 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:04 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 Apr 29 18:14:04 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Attempting download of 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume e9bbd851-50a6-4434-aaf8-8e1aa1065f2f. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[3277912b-504f-4d4c-a6ec-f9cec5b82622]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_ {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:04 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_ Apr 29 18:14:04 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:04 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362" returned: 0 in 0.805s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:04 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362 Apr 29 18:14:04 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:04 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6" returned: 0 in 0.821s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:04 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6 Apr 29 18:14:04 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:05 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_" returned: 0 in 0.770s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_ {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:05 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c 1073741824" returned: 0 in 0.987s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:05 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_ Apr 29 18:14:05 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:05 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c Apr 29 18:14:05 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:05 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362" returned: 0 in 0.681s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Lock "cinder-quobyte-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362" released by "delete_volume" :: held 1.550s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Created reservations ['3bffbddb-a4c7-47e7-864a-d9b6b0137310', 'bcf598d0-24b8-4878-9e34-16855132486b', '6c1652b5-6490-4c99-ad82-acffc990222a', '4f9ce11e-3eaf-48a3-a864-1eafee6c4a39'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:05 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:05 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:05 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6c118114-3967-413f-b73b-bff040dc7ca6" returned: 0 in 0.716s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-quobyte-6c118114-3967-413f-b73b-bff040dc7ca6" released by "delete_volume" :: held 1.582s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Created reservations ['3a901899-3f4e-4a69-8bbe-3876d8523caa', '11fdcda6-b856-4368-a0c4-67e5683f6bed', '1824140c-d87a-4d02-9bc1-380ccdee481d', '81605788-62d6-4ca1-a614-0e5b697a2d90'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:05 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:05 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:05 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_" returned: 1 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_g0p31mp_' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba56f66-38c3-4a9f-8a6f-69c729a3f44b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:05 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c" returned: 0 in 0.657s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.374s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de29138-bd46-4708-9c66-84bc3ea800df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cb49b6-541c-4dab-a5a3-8a10ae5e8849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Creating offline snapshot 43060702-8cdc-4fb6-81ee-b75218363ae3 of volume 67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:14:05 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Volume volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c (6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c): created successfully Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cb49b6-541c-4dab-a5a3-8a10ae5e8849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Flow 'volume_create_manager' (88d381e1-1476-4583-a7a8-423dd3cb97ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b881e8eb-638c-46fb-8add-cacbd2ab4b99]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:05 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD Apr 29 18:14:05 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:05 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-969c93bd-afe0-4443-ad13-a63fe0a8b81c tempest-VolumesTestJSON-248948481 None] Created volume successfully. Apr 29 18:14:06 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:06 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:06 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Deleted volume successfully. Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "cinder-dc7c0436-fa39-4661-9a1a-b9b100655a51-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-df1a465a-784f-4b2f-929b-9cb46ccb5cc5 tempest-VolumesListAdminTestJSON-866907007 None] Lock "cinder-b8d6d8fb-23d9-4208-9a15-6ac4a4a60362-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-dc7c0436-fa39-4661-9a1a-b9b100655a51-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "cinder-quobyte-dc7c0436-fa39-4661-9a1a-b9b100655a51" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-quobyte-dc7c0436-fa39-4661-9a1a-b9b100655a51" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:06 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.751s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce2350-5a45-4f07-bf89-3e49c701d69c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Deleted volume successfully. Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9514396-0fd7-479d-b61d-79cd5f1bf230 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-6c118114-3967-413f-b73b-bff040dc7ca6-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:06 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:06 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 Apr 29 18:14:06 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 was qcow2, converting to raw {{(pid=84402) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:06 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:06 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:06 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.901s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:06 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 1G Apr 29 18:14:06 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:07 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51" returned: 0 in 0.799s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:07 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51 Apr 29 18:14:07 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Flow 'volume_create_manager' (0c7d1aa9-4e34-49bf-b175-8ec820dd829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad797c76-ffa5-46e2-89ff-01dd7ab927bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad797c76-ffa5-46e2-89ff-01dd7ab927bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2007614818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba100cd3-3f65-466d-92b3-a66496cd5961,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1faee2f1a4546af2f71a507db4235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:08Z,use_quota=True,user_id='a35de939a1c24e9ea22adb70e40b6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d96706-f8a5-4559-b5b9-8643661678fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d96706-f8a5-4559-b5b9-8643661678fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34574019-0df0-4b81-9d2e-4f014c2bf7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34574019-0df0-4b81-9d2e-4f014c2bf7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba100cd3-3f65-466d-92b3-a66496cd5961', 'volume_name': 'volume-ba100cd3-3f65-466d-92b3-a66496cd5961', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a1bb5a-a816-4c85-9a7e-4a3f3ec5dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a1bb5a-a816-4c85-9a7e-4a3f3ec5dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076bf84c-7559-420d-b954-4362d23eef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Volume ba100cd3-3f65-466d-92b3-a66496cd5961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba100cd3-3f65-466d-92b3-a66496cd5961', 'volume_size': 1} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:07 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 1G" returned: 0 in 1.008s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d0cf16-6637-419b-87aa-f19400b5b733 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:07 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d0cf16-6637-419b-87aa-f19400b5b733 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 Apr 29 18:14:07 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:08 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dc7c0436-fa39-4661-9a1a-b9b100655a51" returned: 0 in 0.756s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-quobyte-dc7c0436-fa39-4661-9a1a-b9b100655a51" released by "delete_volume" :: held 1.604s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Created reservations ['9dd22cca-e49b-4b35-976b-a72c3818337a', '97323bf4-9733-4e7e-a10b-8c08085b5f0a', '9872f70c-8eb2-444f-99a1-9f93d6810ff5', '42a62032-45a4-46be-8572-95c463a1aab5'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:08 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:08 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:08 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d0cf16-6637-419b-87aa-f19400b5b733 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3" returned: 0 in 0.780s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:08 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 is being set with open permissions: ugo+rw Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:08 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 Apr 29 18:14:08 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:08 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "cinder-c5b07dea-3d2c-46e8-9e10-5bba6d94146e-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 0 in 2.099s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_m92qmwyhdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:14:08 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Converted 112.00 MB image at 53.33 MB/s Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-c5b07dea-3d2c-46e8-9e10-5bba6d94146e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:08 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f 1G Apr 29 18:14:08 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "cinder-quobyte-c5b07dea-3d2c-46e8-9e10-5bba6d94146e" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-quobyte-c5b07dea-3d2c-46e8-9e10-5bba6d94146e" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93606b3-c2a3-4788-97a3-7a9f8cb64878]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:08 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.690s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:08 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Deleted volume successfully. Apr 29 18:14:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-83227c6d-4552-4c42-a311-6970feecfb22 tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-dc7c0436-fa39-4661-9a1a-b9b100655a51-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:08 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e Apr 29 18:14:08 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:09 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3" returned: 0 in 0.688s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:09 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info Apr 29 18:14:09 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:09 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f 1G" returned: 0 in 0.739s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f37b58d-6ae8-4d04-8689-64240071c8c3]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:09 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:09 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:09 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e" returned: 0 in 0.821s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:09 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e Apr 29 18:14:09 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:09 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info" returned: 0 in 0.652s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:09 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info is being set with open permissions: ugo+rw Apr 29 18:14:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:10 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info Apr 29 18:14:10 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:10 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 0 in 0.729s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:10 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c5b07dea-3d2c-46e8-9e10-5bba6d94146e" returned: 0 in 0.631s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-quobyte-c5b07dea-3d2c-46e8-9e10-5bba6d94146e" released by "delete_volume" :: held 1.518s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Created reservations ['a5c24064-e01e-444b-9c09-b0efbc907e29', 'b8724b08-7ae6-4431-b02d-5de4cf136963', 'd4f7b9b5-6070-4aa3-81be-9c5482a2c352', 'b9790048-f085-4512-b9b6-7427a0f621d1'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:10 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:10 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:10 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:10 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:10 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.info" returned: 0 in 0.638s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.839s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.892s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2007614818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba100cd3-3f65-466d-92b3-a66496cd5961,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1faee2f1a4546af2f71a507db4235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:08Z,use_quota=True,user_id='a35de939a1c24e9ea22adb70e40b6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Creating volume ba100cd3-3f65-466d-92b3-a66496cd5961 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:10 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:10 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 1073741824 Apr 29 18:14:10 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b5ce7e4a-ca8b-457b-9e18-ec2c74a43ba0 tempest-VolumesSnapshotTestJSON-1557404375 None] Create snapshot completed successfully Apr 29 18:14:11 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.645s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Deleted volume successfully. Apr 29 18:14:11 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 1 in 0.869s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Downloaded image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume e9bbd851-50a6-4434-aaf8-8e1aa1065f2f successfully. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 for user 78cbf2e25f1f40e58825ccb6e6bb1ef4 is deleted. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Marking volume e9bbd851-50a6-4434-aaf8-8e1aa1065f2f as bootable. {{(pid=84402) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Copying metadata from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 to e9bbd851-50a6-4434-aaf8-8e1aa1065f2f. {{(pid=84402) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Creating volume glance metadata for volume e9bbd851-50a6-4434-aaf8-8e1aa1065f2f backed by image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84402) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e9ea5e3b-de51-4753-8e8b-f1f4c322ec6e tempest-VolumesListAdminTestJSON-1866457516 None] Lock "cinder-c5b07dea-3d2c-46e8-9e10-5bba6d94146e-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fb1b05-9961-4f85-9d4c-a601828304ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b5764c-2aa5-4734-8749-e7f5679c0d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:11 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Volume volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f (e9bbd851-50a6-4434-aaf8-8e1aa1065f2f): created successfully Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b5764c-2aa5-4734-8749-e7f5679c0d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (a7f15d3b-b31d-4439-b3a1-9c4d01dd19bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-06b2e098-8e0e-4fe7-a4ca-0b36063d67c3 tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (1d25e2ca-5112-4214-a57b-b3a0a1c887ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cd250f-81c7-4d5b-854b-1db3c5dfe85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cd250f-81c7-4d5b-854b-1db3c5dfe85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-416793686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecb189c-6762-4a06-8a06-eb9318b764ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=43060702-8cdc-4fb6-81ee-b75218363ae3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:11Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f98db0f-20e5-4e3f-bf60-203e0a6cb4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f98db0f-20e5-4e3f-bf60-203e0a6cb4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b5f094-1247-4d05-8998-3d6c407548d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b5f094-1247-4d05-8998-3d6c407548d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ecb189c-6762-4a06-8a06-eb9318b764ed', 'volume_name': 'volume-3ecb189c-6762-4a06-8a06-eb9318b764ed', 'volume_size': 2, 'snapshot_id': '43060702-8cdc-4fb6-81ee-b75218363ae3'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7fd25e-f6fe-42e9-947a-b61a910098f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7fd25e-f6fe-42e9-947a-b61a910098f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3522c700-f990-4670-8671-2aa01b5bdde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:11 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Volume 3ecb189c-6762-4a06-8a06-eb9318b764ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ecb189c-6762-4a06-8a06-eb9318b764ed', 'volume_size': 2, 'snapshot_id': '43060702-8cdc-4fb6-81ee-b75218363ae3'} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:11 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 1073741824" returned: 0 in 1.058s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:11 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 Apr 29 18:14:11 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=124,cinder:UPDATE=154,cinder:DELETE=19,cinder:INSERT=45 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (ee21a2af-4f2a-42a4-9d1c-9615eea42e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21cc5e5-2485-4b98-a0c4-32c77f5003ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21cc5e5-2485-4b98-a0c4-32c77f5003ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-225234315',display_name='tempest-VolumesGetTest-Volume-1331383599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b32a23-1597-4b65-8b36-4b47c2a278f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:12Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975a570b-370b-49d5-9272-6102124d180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975a570b-370b-49d5-9272-6102124d180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb359b6-bc9d-490e-847f-f3cfd44d54fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb359b6-bc9d-490e-847f-f3cfd44d54fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b32a23-1597-4b65-8b36-4b47c2a278f9', 'volume_name': 'volume-90b32a23-1597-4b65-8b36-4b47c2a278f9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92443624-166f-4278-aa23-195de3f8ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92443624-166f-4278-aa23-195de3f8ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f860493b-15aa-43b6-ad8c-868a275f1bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:12 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Volume 90b32a23-1597-4b65-8b36-4b47c2a278f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b32a23-1597-4b65-8b36-4b47c2a278f9', 'volume_size': 1} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:12 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961" returned: 0 in 0.691s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.848s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-43060702-8cdc-4fb6-81ee-b75218363ae3-3ecb189c-6762-4a06-8a06-eb9318b764ed" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076bf84c-7559-420d-b954-4362d23eef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba100cd3-3f65-466d-92b3-a66496cd5961', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f901ad81-9566-41a4-92ac-8a8ccf41425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-43060702-8cdc-4fb6-81ee-b75218363ae3-3ecb189c-6762-4a06-8a06-eb9318b764ed" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Creating volume 3ecb189c-6762-4a06-8a06-eb9318b764ed from snapshot 43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-3ecb189c-6762-4a06-8a06-eb9318b764ed" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:12 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Volume volume-ba100cd3-3f65-466d-92b3-a66496cd5961 (ba100cd3-3f65-466d-92b3-a66496cd5961): created successfully Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f901ad81-9566-41a4-92ac-8a8ccf41425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Flow 'volume_create_manager' (0c7d1aa9-4e34-49bf-b175-8ec820dd829f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-3ecb189c-6762-4a06-8a06-eb9318b764ed" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] snapshot: 43060702-8cdc-4fb6-81ee-b75218363ae3, volume: 3ecb189c-6762-4a06-8a06-eb9318b764ed, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:14:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-49fc837e-94db-4381-aab8-7f3e43533d27 tempest-VolumesTestJSON-248948481 None] Created volume successfully. Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06bb05b-d66a-4bf5-b72a-2e66a3976689]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:12 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 Apr 29 18:14:12 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:13 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3" returned: 0 in 0.801s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67d0cf16-6637-419b-87aa-f19400b5b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:14:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:14:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:14:13 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[624abe12-0932-4649-b79c-cdcca055aa34]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:13 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:13 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Acquiring lock "cinder-ba100cd3-3f65-466d-92b3-a66496cd5961-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Lock "cinder-ba100cd3-3f65-466d-92b3-a66496cd5961-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Acquiring lock "cinder-quobyte-ba100cd3-3f65-466d-92b3-a66496cd5961" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Lock "cinder-quobyte-ba100cd3-3f65-466d-92b3-a66496cd5961" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:14 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.941s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5ef2ed-d8da-4873-aa30-f40b3480bd53]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:14 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed Apr 29 18:14:14 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:14 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 Apr 29 18:14:14 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:15 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961" returned: 0 in 0.787s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:15 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961 Apr 29 18:14:15 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:16 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ba100cd3-3f65-466d-92b3-a66496cd5961" returned: 0 in 1.224s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Lock "cinder-quobyte-ba100cd3-3f65-466d-92b3-a66496cd5961" released by "delete_volume" :: held 2.096s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Created reservations ['7db88bea-e03f-45d5-8ff4-850b7243bc55', '827d6774-8f67-4b6f-b29f-ad57af10fcd2', '2cab6d1c-c68b-4c97-8bc5-9b9f37878116', '49d00b80-474b-447f-b780-f0687748579f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:16 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:16 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Acquiring lock "cinder-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Lock "cinder-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Acquiring lock "cinder-quobyte-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Lock "cinder-quobyte-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[da734b92-c876-4215-98dd-7f3db42ff27e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:17 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c Apr 29 18:14:17 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:17 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.158s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Deleted volume successfully. Apr 29 18:14:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5163377b-4829-465b-9969-57b048643a2c tempest-VolumesTestJSON-248948481 None] Lock "cinder-ba100cd3-3f65-466d-92b3-a66496cd5961-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:19 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c" returned: 0 in 2.056s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:19 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c Apr 29 18:14:19 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Flow 'volume_create_manager' (50c3b2df-c6a9-461d-9350-74a2f05a386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e09288e-8771-4d10-b5d8-0baddf70c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e09288e-8771-4d10-b5d8-0baddf70c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1885176693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdac74db-f416-4710-a49d-25e1068b9bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae0f6f7ee01844b18fa7e83ead96bdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:19Z,use_quota=True,user_id='53d4f73de89a4336a92f3c68dcbec80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b1c6ce-cfa2-414c-ac04-7a07e05c5c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b1c6ce-cfa2-414c-ac04-7a07e05c5c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c8180c-4389-42ee-a17e-826a0b299a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c8180c-4389-42ee-a17e-826a0b299a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdac74db-f416-4710-a49d-25e1068b9bf9', 'volume_name': 'volume-fdac74db-f416-4710-a49d-25e1068b9bf9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392beb74-d790-4deb-aa2e-7d6ec0599474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392beb74-d790-4deb-aa2e-7d6ec0599474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db1e811-9e34-460c-8f25-62a76b5022eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:19 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Volume fdac74db-f416-4710-a49d-25e1068b9bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdac74db-f416-4710-a49d-25e1068b9bf9', 'volume_size': 1} Apr 29 18:14:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:20 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c" returned: 0 in 1.110s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Lock "cinder-quobyte-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c" released by "delete_volume" :: held 3.273s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Created reservations ['48c259f2-ab23-400f-956a-704ada6aea7b', '8d40ba22-95e2-423d-b7a3-d9e6a3ed0415', '2eaf908c-dd27-4f2a-b56b-74f3b9d64279', '20bcfe80-8142-4e80-ab97-4cf64a310f19'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:20 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed" returned: 0 in 6.021s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a62cc-0e93-4481-963f-3a50e2ebcff1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Acquiring lock "cinder-f3f20c98-2ffa-4c86-a180-3bbaa957b5be-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:20 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:20 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Lock "cinder-f3f20c98-2ffa-4c86-a180-3bbaa957b5be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Acquiring lock "cinder-quobyte-f3f20c98-2ffa-4c86-a180-3bbaa957b5be" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Lock "cinder-quobyte-f3f20c98-2ffa-4c86-a180-3bbaa957b5be" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:20 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:20 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b454b5ee-b25e-4b53-9185-5931c5fb0a8f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:20 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be Apr 29 18:14:20 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:21 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.687s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:21 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Deleted volume successfully. Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-313aa3c9-3886-408a-9ea6-08eda03c7899 tempest-VolumesTestJSON-248948481 None] Lock "cinder-6fce3c6f-aa4f-4fcf-a11e-b86c2c14948c-delete_volume" released by "delete_volume" :: held 4.273s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:21 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.943s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:14:21 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Converted 1024.00 MB image at 170.01 MB/s Apr 29 18:14:21 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed is being set with open permissions: ugo+rw Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:21 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be" returned: 0 in 0.755s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:21 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed Apr 29 18:14:21 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:21 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be Apr 29 18:14:21 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:21 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f3f20c98-2ffa-4c86-a180-3bbaa957b5be" returned: 0 in 0.622s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:21 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed" returned: 0 in 0.642s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Lock "cinder-quobyte-f3f20c98-2ffa-4c86-a180-3bbaa957b5be" released by "delete_volume" :: held 1.428s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-3ecb189c-6762-4a06-8a06-eb9318b764ed" released by "_copy_volume_from_snapshot" :: held 9.482s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-43060702-8cdc-4fb6-81ee-b75218363ae3-3ecb189c-6762-4a06-8a06-eb9318b764ed" released by "_create_volume_from_snapshot" :: held 9.531s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.565s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.705s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-225234315',display_name='tempest-VolumesGetTest-Volume-1331383599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b32a23-1597-4b65-8b36-4b47c2a278f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6f31f1079400aa7175898d117a146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:12Z,use_quota=True,user_id='78cbf2e25f1f40e58825ccb6e6bb1ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Creating volume 90b32a23-1597-4b65-8b36-4b47c2a278f9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:22 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:22 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 1073741824 Apr 29 18:14:22 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3522c700-f990-4670-8671-2aa01b5bdde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ecb189c-6762-4a06-8a06-eb9318b764ed', 'volume_size': 2, 'snapshot_id': '43060702-8cdc-4fb6-81ee-b75218363ae3'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6403467a-f82b-41a1-95b0-085aa7257957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Volume volume-3ecb189c-6762-4a06-8a06-eb9318b764ed (3ecb189c-6762-4a06-8a06-eb9318b764ed): created successfully Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6403467a-f82b-41a1-95b0-085aa7257957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (1d25e2ca-5112-4214-a57b-b3a0a1c887ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Created reservations ['52c81531-e59c-48c8-8576-b1db1752283b', 'c1404eb1-df17-4ef3-8321-1ac2ac525c5c', '7b09d678-72ff-4b92-9d89-dbdb35c056ac', 'eb4b1500-7552-4a33-b92e-b1f99628e935'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-976c3ba9-e466-4407-87fa-087a41dab98f tempest-VolumesSnapshotTestJSON-1557404375 None] Created volume successfully. Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:22 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:22 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:22 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:22 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 1073741824" returned: 0 in 0.822s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Deleted volume successfully. Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3f2751ee-9f16-4b4c-aaca-08eefea1b596 tempest-VolumesTestJSON-248948481 None] Lock "cinder-f3f20c98-2ffa-4c86-a180-3bbaa957b5be-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-3ecb189c-6762-4a06-8a06-eb9318b764ed-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:22 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 Apr 29 18:14:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-3ecb189c-6762-4a06-8a06-eb9318b764ed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:22 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-3ecb189c-6762-4a06-8a06-eb9318b764ed" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-3ecb189c-6762-4a06-8a06-eb9318b764ed" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[324348da-3980-42b3-814b-87785c2f96ce]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:23 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed Apr 29 18:14:23 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:23 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9" returned: 0 in 0.691s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.984s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1885176693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdac74db-f416-4710-a49d-25e1068b9bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae0f6f7ee01844b18fa7e83ead96bdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:19Z,use_quota=True,user_id='53d4f73de89a4336a92f3c68dcbec80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Creating volume fdac74db-f416-4710-a49d-25e1068b9bf9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:23 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:23 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 1073741824 Apr 29 18:14:23 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f860493b-15aa-43b6-ad8c-868a275f1bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b32a23-1597-4b65-8b36-4b47c2a278f9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752be9ed-8957-402b-8ce3-3fc956ebd850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:23 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Volume volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 (90b32a23-1597-4b65-8b36-4b47c2a278f9): created successfully Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752be9ed-8957-402b-8ce3-3fc956ebd850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Flow 'volume_create_manager' (ee21a2af-4f2a-42a4-9d1c-9615eea42e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-30f97f5d-b0d8-407e-8f30-7e10a9b52537 tempest-VolumesGetTest-2132558532 None] Created volume successfully. Apr 29 18:14:23 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed" returned: 0 in 0.816s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:23 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed Apr 29 18:14:23 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:24 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3ecb189c-6762-4a06-8a06-eb9318b764ed" returned: 0 in 0.709s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-90b32a23-1597-4b65-8b36-4b47c2a278f9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-3ecb189c-6762-4a06-8a06-eb9318b764ed" released by "delete_volume" :: held 1.594s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Lock "cinder-90b32a23-1597-4b65-8b36-4b47c2a278f9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:24 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 1073741824" returned: 0 in 1.055s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-90b32a23-1597-4b65-8b36-4b47c2a278f9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['38ac7c5f-23c8-4d39-b4fe-b0e93d1e1103', 'e20d0e8d-136b-41ee-8544-7ae37ef06310', '51ee3519-0ff0-464f-a049-75983ae438b6', '579ba9f9-b3c1-489c-94ae-f82547bc26d8'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-90b32a23-1597-4b65-8b36-4b47c2a278f9" acquired by "delete_volume" :: waited 0.041s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:24 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 Apr 29 18:14:24 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051f3d1-eb0f-4843-be36-92a9e96e906e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:24 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:24 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:24 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 Apr 29 18:14:24 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-43060702-8cdc-4fb6-81ee-b75218363ae3-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-43060702-8cdc-4fb6-81ee-b75218363ae3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-67d0cf16-6637-419b-87aa-f19400b5b733" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-67d0cf16-6637-419b-87aa-f19400b5b733" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-43060702-8cdc-4fb6-81ee-b75218363ae3" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-43060702-8cdc-4fb6-81ee-b75218363ae3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Deleting offline snapshot 43060702-8cdc-4fb6-81ee-b75218363ae3 of volume 67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] snapshot_file for this snap is: volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8d559-1e38-4fc9-9a56-3233458126ca]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:25 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9" returned: 0 in 0.746s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db1e811-9e34-460c-8f25-62a76b5022eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdac74db-f416-4710-a49d-25e1068b9bf9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad5ee6e-6860-4b19-9c10-575dc371bbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:25 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Volume volume-fdac74db-f416-4710-a49d-25e1068b9bf9 (fdac74db-f416-4710-a49d-25e1068b9bf9): created successfully Apr 29 18:14:25 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 Apr 29 18:14:25 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad5ee6e-6860-4b19-9c10-575dc371bbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Flow 'volume_create_manager' (50c3b2df-c6a9-461d-9350-74a2f05a386e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:25 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-374eece7-79fd-447a-8fd0-2c4fef62ce10 tempest-AbsoluteLimitsTests-55052330 None] Created volume successfully. Apr 29 18:14:25 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.894s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:25 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Deleted volume successfully. Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f53ca23-cd42-48db-afd1-e11f36da014d tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-3ecb189c-6762-4a06-8a06-eb9318b764ed-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:25 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9" returned: 0 in 1.062s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:25 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9 Apr 29 18:14:25 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Acquiring lock "cinder-fdac74db-f416-4710-a49d-25e1068b9bf9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Lock "cinder-fdac74db-f416-4710-a49d-25e1068b9bf9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Acquiring lock "cinder-quobyte-fdac74db-f416-4710-a49d-25e1068b9bf9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Lock "cinder-quobyte-fdac74db-f416-4710-a49d-25e1068b9bf9" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb944091-b65f-4653-95d4-a48023d2f0c9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:26 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 Apr 29 18:14:26 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:26 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3" returned: 0 in 0.966s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67d0cf16-6637-419b-87aa-f19400b5b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd316485-3276-4912-908a-f2b572262d16]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:26 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:26 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:26 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-90b32a23-1597-4b65-8b36-4b47c2a278f9" returned: 0 in 0.773s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-90b32a23-1597-4b65-8b36-4b47c2a278f9" released by "delete_volume" :: held 1.905s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Created reservations ['a35ec96f-a1f7-462c-9778-d98c467f67a1', 'f37f8dc1-525a-4677-b080-3401fd2b3c50', 'cbaa4821-5f0a-4f22-ba83-db805b4ae2f1', '91bf4fc3-83bf-4911-bb6c-5135164c80dd'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:26 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:26 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:27 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9" returned: 0 in 0.842s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:27 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9 Apr 29 18:14:27 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:27 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.863s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:27 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 Apr 29 18:14:27 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:27 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.756s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:27 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5e37eda8-4719-42f5-b5db-e58c5ba6fcd1 tempest-VolumesGetTest-2132558532 None] Lock "cinder-90b32a23-1597-4b65-8b36-4b47c2a278f9-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:27 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fdac74db-f416-4710-a49d-25e1068b9bf9" returned: 0 in 0.752s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Lock "cinder-quobyte-fdac74db-f416-4710-a49d-25e1068b9bf9" released by "delete_volume" :: held 1.647s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Created reservations ['35d9260c-2c0c-490f-8c6f-f3ed17d0e67b', 'cf94aed9-db6d-47be-9649-cba7935165d0', '86047755-9dda-4e04-b4b5-995b476db0be', 'a1a58d34-a162-4e67-aa2f-1dd02875c44f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:28 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:28 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Lock "cinder-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Acquiring lock "cinder-quobyte-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" acquired by "delete_volume" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f2e06f-4c6b-406c-9956-6fbee4d0c703]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:28 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3" returned: 0 in 0.929s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:28 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3 Apr 29 18:14:28 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:28 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:28 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:28 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.985s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:28 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Deleted volume successfully. Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-ad27a19c-3348-4a19-b0eb-2ac737fb0440 tempest-AbsoluteLimitsTests-55052330 None] Lock "cinder-fdac74db-f416-4710-a49d-25e1068b9bf9-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:29 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 0 in 0.895s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:29 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733.43060702-8cdc-4fb6-81ee-b75218363ae3" returned: 0 in 0.887s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-43060702-8cdc-4fb6-81ee-b75218363ae3" released by "_delete_snapshot" :: held 3.816s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-67d0cf16-6637-419b-87aa-f19400b5b733" released by "delete_snapshot" :: held 3.860s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['027c32c8-0ef9-422a-af56-7ba9392e971b', 'e9ef3500-6669-4487-9b7d-b975424f7b58', '666799da-a066-41bb-af5a-fa1ebc5c4cf3', 'b9b45c61-702a-4a66-a732-ea87d8508a05'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:29 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:29 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Delete snapshot completed successfully. Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cfb1a625-e757-47f5-b371-4f8e3cae56eb tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-43060702-8cdc-4fb6-81ee-b75218363ae3-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-67d0cf16-6637-419b-87aa-f19400b5b733-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-67d0cf16-6637-419b-87aa-f19400b5b733-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-67d0cf16-6637-419b-87aa-f19400b5b733" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-67d0cf16-6637-419b-87aa-f19400b5b733" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84606c0-a8ae-48a8-a658-22c32c3c83b8]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:30 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:30 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:30 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 1 in 0.979s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:30 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f Apr 29 18:14:30 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:30 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.886s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:30 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733 Apr 29 18:14:30 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:30 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Lock "cinder-quobyte-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f" released by "delete_volume" :: held 2.710s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:30 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Created reservations ['99657ad2-a560-4fd4-9759-9580d732d42e', '2123f649-cb0e-49cf-a512-46dfc3143aeb', '183d8064-e53e-4114-adb8-1263f79229e7', 'ab8022c2-6f4c-4d3e-af3f-dea5a8b81e5e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:31 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:31 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:31 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67d0cf16-6637-419b-87aa-f19400b5b733" returned: 0 in 0.840s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-67d0cf16-6637-419b-87aa-f19400b5b733" released by "delete_volume" :: held 1.829s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['069844ff-9b6c-4bba-bb16-67130d6a1c5d', 'cd767aa5-71a7-4b1e-92a9-7a9f4cbc998d', '6ce5aa5a-dba6-4dca-adb9-03c57119a557', '27211560-f9fa-4f72-a38b-4eeb311c6b0c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:31 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.790s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:31 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Deleted volume successfully. Apr 29 18:14:31 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:31 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b9c14215-dbd1-4d60-8006-d4ea72a0b4de tempest-VolumesGetTest-2132558532 None] Lock "cinder-e9bbd851-50a6-4434-aaf8-8e1aa1065f2f-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-aa6af6d4-9fad-4af1-bfe0-76887940c8e6 tempest-GroupSnapshotsTest-550771466 None] Group tempest-GroupSnapshotsTest-Group-493789132: creating Apr 29 18:14:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-aa6af6d4-9fad-4af1-bfe0-76887940c8e6 tempest-GroupSnapshotsTest-550771466 None] Group tempest-GroupSnapshotsTest-Group-493789132: created successfully Apr 29 18:14:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-aa6af6d4-9fad-4af1-bfe0-76887940c8e6 tempest-GroupSnapshotsTest-550771466 None] Create group completed successfully. Apr 29 18:14:32 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.905s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Deleted volume successfully. Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-70034fa8-56b5-4f73-8b8d-30883c69d71b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-67d0cf16-6637-419b-87aa-f19400b5b733-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (2041635c-6035-456a-9c5b-abe0c69d3262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a765bd-1d96-4875-8e5a-79fb2382e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a765bd-1d96-4875-8e5a-79fb2382e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-618032026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a77276-3fab-4866-bd06-eb9dd8a636d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:33Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ba8905-5db1-46bc-99c8-25d4c543cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ba8905-5db1-46bc-99c8-25d4c543cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9a7c28-e1c1-4ee1-89b8-5837f105ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9a7c28-e1c1-4ee1-89b8-5837f105ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a77276-3fab-4866-bd06-eb9dd8a636d9', 'volume_name': 'volume-31a77276-3fab-4866-bd06-eb9dd8a636d9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63108f76-d261-4765-8274-5047869926c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63108f76-d261-4765-8274-5047869926c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b67513-f3d8-4891-aaba-46a8d6e15e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:32 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Volume 31a77276-3fab-4866-bd06-eb9dd8a636d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a77276-3fab-4866-bd06-eb9dd8a636d9', 'volume_size': 1} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-618032026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a77276-3fab-4866-bd06-eb9dd8a636d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:33Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Creating volume 31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:33 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:33 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 1073741824 Apr 29 18:14:33 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:33 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 1073741824" returned: 0 in 0.987s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:34 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:14:34 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (2e488d13-f2fb-4dae-8c93-bab105cdfa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66681e5-5921-4c90-b780-5ee950b1cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66681e5-5921-4c90-b780-5ee950b1cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279273945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7ca9631-5dd4-4e6f-920b-32d7097da0e7,host='devstack@QuobyteHD#QuobyteHD',id=a6e41a67-9b50-4b3c-a162-889bbcead7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:34Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(475a4fcc-7b39-473d-aaec-f3730b08d351),volume_type_id=475a4fcc-7b39-473d-aaec-f3730b08d351)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e4ded8-ba3a-4d1b-b0de-1dae082792e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e4ded8-ba3a-4d1b-b0de-1dae082792e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46ef8c2-173e-4e24-8076-af54e6cee04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46ef8c2-173e-4e24-8076-af54e6cee04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e41a67-9b50-4b3c-a162-889bbcead7f1', 'volume_name': 'volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f337b4-3458-48dc-b7bf-768df3725753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f337b4-3458-48dc-b7bf-768df3725753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e07f648-9ede-47ed-a572-84ed77b6e8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:34 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Volume a6e41a67-9b50-4b3c-a162-889bbcead7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1', 'volume_size': 1} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:34 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 0.639s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7ca9631-5dd4-4e6f-920b-32d7097da0e7,created_at=2026-04-29T16:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279273945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7ca9631-5dd4-4e6f-920b-32d7097da0e7,host='devstack@QuobyteHD#QuobyteHD',id=a6e41a67-9b50-4b3c-a162-889bbcead7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:34Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(475a4fcc-7b39-473d-aaec-f3730b08d351),volume_type_id=475a4fcc-7b39-473d-aaec-f3730b08d351)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Creating volume a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:34 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b67513-f3d8-4891-aaba-46a8d6e15e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a77276-3fab-4866-bd06-eb9dd8a636d9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:34 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 1073741824 Apr 29 18:14:34 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e22a66-a236-408c-977b-52624c5d9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:34 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Volume volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 (31a77276-3fab-4866-bd06-eb9dd8a636d9): created successfully Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e22a66-a236-408c-977b-52624c5d9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (2041635c-6035-456a-9c5b-abe0c69d3262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:34 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e59de098-c104-424f-b966-a24326106896 tempest-VolumesSnapshotTestJSON-1557404375 None] Created volume successfully. Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (dc433851-4b88-4ca1-a748-09dcd10e9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:35 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92674db-5278-4946-84d4-c79cec9544d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 1073741824" returned: 0 in 0.980s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92674db-5278-4946-84d4-c79cec9544d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1946695122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccc9585-df82-43d8-b866-bccba206b574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c993358d93d54a18be9d06878977aead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:36Z,use_quota=True,user_id='15420469894746568998a04fc0c1d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172d2f1c-6e0f-4170-8c22-6d489926afc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172d2f1c-6e0f-4170-8c22-6d489926afc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c7af86-6939-4928-807a-10e8be4196a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c7af86-6939-4928-807a-10e8be4196a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccc9585-df82-43d8-b866-bccba206b574', 'volume_name': 'volume-fccc9585-df82-43d8-b866-bccba206b574', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a2677d-0f62-4368-8f56-1f4b32ddf709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a2677d-0f62-4368-8f56-1f4b32ddf709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4dafb04-ad40-4f32-b4b6-2a2415144803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:35 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Volume fccc9585-df82-43d8-b866-bccba206b574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccc9585-df82-43d8-b866-bccba206b574', 'volume_size': 1} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:35 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:14:35 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:35 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:35 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:36 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 0.612s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.028s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:36 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e07f648-9ede-47ed-a572-84ed77b6e8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e393281-c3a7-4dc6-8046-13b1782ec2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.639s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Creating offline snapshot ee1d5941-5dd3-4137-866e-a71a077ad748 of volume 31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:14:36 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Volume volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 (a6e41a67-9b50-4b3c-a162-889bbcead7f1): created successfully Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e393281-c3a7-4dc6-8046-13b1782ec2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (2e488d13-f2fb-4dae-8c93-bab105cdfa66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa48916a-22a1-46ab-ad80-621780eeb77a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:36 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8e28a516-0ece-4c92-9592-40dd3c20f4c0 tempest-GroupSnapshotsTest-550771466 None] Created volume successfully. Apr 29 18:14:36 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:14:36 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Flow 'volume_create_manager' (52729801-7af2-4e68-8ed1-f933a13063ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7604a2e7-c835-472e-b4c8-9fd218107f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7604a2e7-c835-472e-b4c8-9fd218107f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1553134965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002734fc-5c1e-4a57-a57b-cbd21c765b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73fc10c80e6f44cb85ed852024fab255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:37Z,use_quota=True,user_id='68db8772ea6d4deea7b9f2b91371b7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4278279-c246-4d48-971e-562dbbe14836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4278279-c246-4d48-971e-562dbbe14836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a480cc-71fa-4773-b6d5-f356f697e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a480cc-71fa-4773-b6d5-f356f697e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002734fc-5c1e-4a57-a57b-cbd21c765b46', 'volume_name': 'volume-002734fc-5c1e-4a57-a57b-cbd21c765b46', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacabda9-050c-47eb-b8a5-5163f99292c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacabda9-050c-47eb-b8a5-5163f99292c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637cf3f2-a2c7-49f6-af04-f9b812f9e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:36 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Volume 002734fc-5c1e-4a57-a57b-cbd21c765b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002734fc-5c1e-4a57-a57b-cbd21c765b46', 'volume_size': 1} Apr 29 18:14:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:37 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 0.762s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:37 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 1G Apr 29 18:14:37 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] GroupSnapshot 29f6be33-7d43-47e4-be19-dee48a03b6d0: creating. Apr 29 18:14:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Group snapshot 29f6be33-7d43-47e4-be19-dee48a03b6d0: creating. {{(pid=84402) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 18:14:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:38 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 1G" returned: 0 in 0.767s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:38 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 Apr 29 18:14:38 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:38 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748" returned: 0 in 0.640s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:38 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 is being set with open permissions: ugo+rw Apr 29 18:14:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:38 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 Apr 29 18:14:38 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:39 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748" returned: 0 in 0.583s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:39 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info Apr 29 18:14:39 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:39 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info" returned: 0 in 0.608s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:39 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info is being set with open permissions: ugo+rw Apr 29 18:14:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:39 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info Apr 29 18:14:39 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:40 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.info" returned: 0 in 0.573s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.089s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.740s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1946695122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccc9585-df82-43d8-b866-bccba206b574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c993358d93d54a18be9d06878977aead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:36Z,use_quota=True,user_id='15420469894746568998a04fc0c1d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Creating volume fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:40 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:40 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 1073741824 Apr 29 18:14:40 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:40 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8d22db30-6d1f-4f6c-97ab-f83127e62740 tempest-VolumesSnapshotTestJSON-1557404375 None] Create snapshot completed successfully Apr 29 18:14:40 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=207,cinder:SELECT=147,cinder:INSERT=51,cinder:DELETE=18 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (70c018d1-b1ee-4ccc-bded-d65ee0963afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e755cb8-b011-4df3-963c-3aa9e8ad8445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e755cb8-b011-4df3-963c-3aa9e8ad8445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-769586141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcd9a7f-6592-45ed-b4d3-82178b75d79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867f4b440a454287b4f8430171230272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee1d5941-5dd3-4137-866e-a71a077ad748,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:41Z,use_quota=True,user_id='d7fb288ac17e4314a921bba7393711e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290f3147-b03e-4e1e-954c-67783ed9435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290f3147-b03e-4e1e-954c-67783ed9435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d76dc80-e7e9-470f-b246-1be7602a47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d76dc80-e7e9-470f-b246-1be7602a47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ddcd9a7f-6592-45ed-b4d3-82178b75d79a', 'volume_name': 'volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a', 'volume_size': 1, 'snapshot_id': 'ee1d5941-5dd3-4137-866e-a71a077ad748'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26640816-bbaf-47b0-82e4-93146e528955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26640816-bbaf-47b0-82e4-93146e528955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad45c13-5d2c-447d-9100-a6c13a0aa0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Volume ddcd9a7f-6592-45ed-b4d3-82178b75d79a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a', 'volume_size': 1, 'snapshot_id': 'ee1d5941-5dd3-4137-866e-a71a077ad748'} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:41 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 1073741824" returned: 0 in 0.848s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:41 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:14:41 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:41 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 0.572s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.028s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1553134965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002734fc-5c1e-4a57-a57b-cbd21c765b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73fc10c80e6f44cb85ed852024fab255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:14:37Z,use_quota=True,user_id='68db8772ea6d4deea7b9f2b91371b7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Creating volume 002734fc-5c1e-4a57-a57b-cbd21c765b46 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:41 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:41 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 1073741824 Apr 29 18:14:41 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4dafb04-ad40-4f32-b4b6-2a2415144803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccc9585-df82-43d8-b866-bccba206b574', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3534878-5c04-4a41-8f51-4e0049e4d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Volume volume-fccc9585-df82-43d8-b866-bccba206b574 (fccc9585-df82-43d8-b866-bccba206b574): created successfully Apr 29 18:14:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3534878-5c04-4a41-8f51-4e0049e4d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (dc433851-4b88-4ca1-a748-09dcd10e9884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-243244c6-5331-4a00-9e1d-a8581aea2c17 tempest-VolumeDependencyTests-543752546 None] Created volume successfully. Apr 29 18:14:42 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 1073741824" returned: 0 in 0.771s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:42 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 Apr 29 18:14:42 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:43 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.530s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637cf3f2-a2c7-49f6-af04-f9b812f9e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002734fc-5c1e-4a57-a57b-cbd21c765b46', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31bcf23-6cb2-462c-8322-af13b371d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Creating offline snapshot 49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 of volume a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:14:43 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Volume volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 (002734fc-5c1e-4a57-a57b-cbd21c765b46): created successfully Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31bcf23-6cb2-462c-8322-af13b371d58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Flow 'volume_create_manager' (52729801-7af2-4e68-8ed1-f933a13063ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e2e3f9-ed9b-4734-b352-53c021314243]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7450cd45-a1fd-4273-91d5-ba282b24eba0 tempest-VolumesNegativeTest-549673198 None] Created volume successfully. Apr 29 18:14:43 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:14:43 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:44 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 0.721s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:44 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 1G Apr 29 18:14:44 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:44 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 1G" returned: 0 in 0.811s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:44 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 Apr 29 18:14:44 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:45 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" returned: 0 in 0.663s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:45 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:14:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:45 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 Apr 29 18:14:45 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:46 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" returned: 0 in 0.627s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:46 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info Apr 29 18:14:46 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:46 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info" returned: 0 in 0.647s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:46 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:14:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:46 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info Apr 29 18:14:46 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:47 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.info" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.195s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.285s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-ee1d5941-5dd3-4137-866e-a71a077ad748-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ee1d5941-5dd3-4137-866e-a71a077ad748-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Creating volume ddcd9a7f-6592-45ed-b4d3-82178b75d79a from snapshot ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] snapshot: ee1d5941-5dd3-4137-866e-a71a077ad748, volume: ddcd9a7f-6592-45ed-b4d3-82178b75d79a, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0157bc-1b42-422b-bc90-eac54c9aa670]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d06e3c20-f5b8-4d2a-81b8-caff908ba366 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 29f6be33-7d43-47e4-be19-dee48a03b6d0: created successfully Apr 29 18:14:47 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 Apr 29 18:14:47 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:48 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748" returned: 0 in 0.764s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a77276-3fab-4866-bd06-eb9dd8a636d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:14:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:14:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:14:48 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d002f4-cf23-4896-b3e7-a8695acaaf23]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:48 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:14:48 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:49 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 0.715s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:49 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:14:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:49 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a Apr 29 18:14:49 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:54 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" returned: 0 in 5.682s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:54 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1871589c-be1e-4619-af6a-ff37c8d85e1e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:54 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:14:54 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:55 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 0.856s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:55 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:14:55 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Converted 1024.00 MB image at 180.18 MB/s Apr 29 18:14:55 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a is being set with open permissions: ugo+rw Apr 29 18:14:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:55 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a Apr 29 18:14:55 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:56 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" returned: 0 in 0.579s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" released by "_copy_volume_from_snapshot" :: held 8.689s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ee1d5941-5dd3-4137-866e-a71a077ad748-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" released by "_create_volume_from_snapshot" :: held 8.727s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.758s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.955s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Creating offline snapshot cbf193f4-214a-487d-a9d3-0658fcfe8382 of volume fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad45c13-5d2c-447d-9100-a6c13a0aa0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a', 'volume_size': 1, 'snapshot_id': 'ee1d5941-5dd3-4137-866e-a71a077ad748'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb48041-6ae1-45bd-b45d-37e9804ac827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b0eab1-b6de-496b-b7f1-aace66366b53]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:56 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Volume volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a (ddcd9a7f-6592-45ed-b4d3-82178b75d79a): created successfully Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb48041-6ae1-45bd-b45d-37e9804ac827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:14:56 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Flow 'volume_create_manager' (70c018d1-b1ee-4ccc-bded-d65ee0963afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:14:56 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-519a2726-b361-4ce1-a161-8a94d98adb5a tempest-VolumesSnapshotTestJSON-1557404375 None] Created volume successfully. Apr 29 18:14:56 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:14:56 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:57 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 0.749s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:57 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 1G Apr 29 18:14:57 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-ddcd9a7f-6592-45ed-b4d3-82178b75d79a-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-ddcd9a7f-6592-45ed-b4d3-82178b75d79a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" acquired by "delete_volume" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9cc675-6bec-4448-97bc-aa615b02b447]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:57 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a Apr 29 18:14:57 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:57 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 1G" returned: 0 in 0.882s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccc9585-df82-43d8-b866-bccba206b574 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:58 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccc9585-df82-43d8-b866-bccba206b574 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 Apr 29 18:14:58 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:58 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:58 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a Apr 29 18:14:58 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:58 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccc9585-df82-43d8-b866-bccba206b574 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382" returned: 0 in 0.621s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:58 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 is being set with open permissions: ugo+rw Apr 29 18:14:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:58 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 Apr 29 18:14:58 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:59 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" returned: 0 in 0.608s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ddcd9a7f-6592-45ed-b4d3-82178b75d79a" released by "delete_volume" :: held 1.408s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['ab1e0e8f-3469-4794-a77b-45bedae17ccc', '31cdbb60-33b4-4ea8-96cd-a33737148b20', '3a625bf4-a292-468d-9094-39e59c559a50', '96982355-97d4-4133-b4e7-466f5ec9526c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:14:59 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382" returned: 0 in 0.636s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:14:59 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:14:59 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:14:59 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info Apr 29 18:14:59 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-ee1d5941-5dd3-4137-866e-a71a077ad748-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-ee1d5941-5dd3-4137-866e-a71a077ad748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-31a77276-3fab-4866-bd06-eb9dd8a636d9" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-31a77276-3fab-4866-bd06-eb9dd8a636d9" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-ee1d5941-5dd3-4137-866e-a71a077ad748" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ee1d5941-5dd3-4137-866e-a71a077ad748" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Deleting offline snapshot ee1d5941-5dd3-4137-866e-a71a077ad748 of volume 31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] snapshot_file for this snap is: volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85561e3-7819-4d37-83ab-bc2cb4dd3a2a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:00 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 Apr 29 18:15:00 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:00 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.345s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:00 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Deleted volume successfully. Apr 29 18:15:00 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info" returned: 0 in 1.360s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:00 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info is being set with open permissions: ugo+rw Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:00 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info Apr 29 18:15:00 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-603f2271-c422-48ce-8cd4-5242fff2805f tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-ddcd9a7f-6592-45ed-b4d3-82178b75d79a-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:01 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748" returned: 0 in 1.018s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a77276-3fab-4866-bd06-eb9dd8a636d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f97539f-0268-4b6b-a571-a224bdb1ec57]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:01 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.info" returned: 0 in 0.691s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.075s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.079s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-49c03ea6-0efa-4db9-b9e0-d7ec22fa9925-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-49c03ea6-0efa-4db9-b9e0-d7ec22fa9925-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Creating volume 50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb from snapshot 49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:01 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:15:01 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:01 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2efaaf25-a9d3-4520-be62-eac270cb0e25 tempest-VolumeDependencyTests-543752546 None] Create snapshot completed successfully Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] snapshot: 49c03ea6-0efa-4db9-b9e0-d7ec22fa9925, volume: 50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c717b7-6ee2-401b-8956-2d9bbadc72b7]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:01 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 Apr 29 18:15:01 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:02 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 0.925s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:02 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 Apr 29 18:15:02 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:02 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" returned: 0 in 1.089s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e516d2-c7e0-4fb5-83b5-6243b26dda38]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:02 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:15:02 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (bccccb88-b9e0-4903-902f-7c35b9977a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3520ba-106e-4cf6-a0e7-a17e2165623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3520ba-106e-4cf6-a0e7-a17e2165623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-138981036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fbf27f-1e0b-4914-bd4c-53560be27c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c993358d93d54a18be9d06878977aead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cbf193f4-214a-487d-a9d3-0658fcfe8382,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:03Z,use_quota=True,user_id='15420469894746568998a04fc0c1d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61002476-6a85-40d1-9b7f-b368381cec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61002476-6a85-40d1-9b7f-b368381cec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486e5b7c-3383-4dbf-9248-a78fa09e5340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486e5b7c-3383-4dbf-9248-a78fa09e5340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63fbf27f-1e0b-4914-bd4c-53560be27c2a', 'volume_name': 'volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a', 'volume_size': 1, 'snapshot_id': 'cbf193f4-214a-487d-a9d3-0658fcfe8382'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:03 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8871c0d-6e52-4b3b-8e43-49191f2b8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8871c0d-6e52-4b3b-8e43-49191f2b8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84525106-c47b-46ef-b47e-2019968bddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:03 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Volume 63fbf27f-1e0b-4914-bd4c-53560be27c2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a', 'volume_size': 1, 'snapshot_id': 'cbf193f4-214a-487d-a9d3-0658fcfe8382'} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748" returned: 0 in 1.014s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:03 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748 Apr 29 18:15:03 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:03 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 1.134s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:15:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:03 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb Apr 29 18:15:03 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:04 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9.ee1d5941-5dd3-4137-866e-a71a077ad748" returned: 0 in 0.832s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-ee1d5941-5dd3-4137-866e-a71a077ad748" released by "_delete_snapshot" :: held 3.957s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-31a77276-3fab-4866-bd06-eb9dd8a636d9" released by "delete_snapshot" :: held 3.995s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['9f83b7f6-7c2a-42bd-baa3-05372198eb5b', '9f0b19d6-b207-4716-8008-70868dd89d79', 'e31aeb80-ae3b-4df1-a00a-be0784dad860', 'a90260b1-9056-4240-bddb-e0a359fb0b63'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Delete snapshot completed successfully. Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6aaadab4-d6bb-4f86-adff-fd66173dbaf2 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-ee1d5941-5dd3-4137-866e-a71a077ad748-delete_snapshot" released by "delete_snapshot" :: held 4.199s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-31a77276-3fab-4866-bd06-eb9dd8a636d9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-31a77276-3fab-4866-bd06-eb9dd8a636d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-31a77276-3fab-4866-bd06-eb9dd8a636d9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-31a77276-3fab-4866-bd06-eb9dd8a636d9" acquired by "delete_volume" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb7a902-d02f-4a42-9220-f50e8386daf5]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:05 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:15:05 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:06 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 1.819s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:06 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9 Apr 29 18:15:06 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:08 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31a77276-3fab-4866-bd06-eb9dd8a636d9" returned: 0 in 1.430s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-31a77276-3fab-4866-bd06-eb9dd8a636d9" released by "delete_volume" :: held 3.494s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['efaf988b-94f9-42f8-a2d0-1ed803ab417b', 'a13ed49a-ae0b-4d0c-838d-1af145f1dcce', 'f9a00711-bd1f-4aa0-ab22-5c5e47642780', '73c93578-0afd-4949-9d3d-bd777c3ef478'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:08 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:08 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-7aaed85b-1588-455b-a0da-89faf6a77176-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-7aaed85b-1588-455b-a0da-89faf6a77176-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "cinder-quobyte-7aaed85b-1588-455b-a0da-89faf6a77176" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-7aaed85b-1588-455b-a0da-89faf6a77176" acquired by "delete_volume" :: waited 0.059s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d506e3f0-3304-4fe8-9d2a-abd3b97fe6c5]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:10 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 Apr 29 18:15:10 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:10 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.826s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Deleted volume successfully. Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-591097a5-f780-452e-8b30-1c7c32f0c5d5 tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-31a77276-3fab-4866-bd06-eb9dd8a636d9-delete_volume" released by "delete_volume" :: held 6.039s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:10 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" returned: 0 in 6.881s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa470400-e54f-4d81-b2a2-fba7d860ade8]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:10 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:15:10 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:11 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176" returned: 0 in 1.002s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:11 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176 Apr 29 18:15:11 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:11 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 0.905s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:15:11 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Converted 1024.00 MB image at 148.79 MB/s Apr 29 18:15:11 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:11 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb Apr 29 18:15:11 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:11 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7aaed85b-1588-455b-a0da-89faf6a77176" returned: 0 in 0.623s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-quobyte-7aaed85b-1588-455b-a0da-89faf6a77176" released by "delete_volume" :: held 1.809s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Created reservations ['e9193d47-b0af-4ff6-96cf-61f7c4b227d4', 'db1506f6-38f3-420a-a125-08b77a3d950e', '4834ed8c-3830-43a8-a31e-4ae6f6536206', 'f75576f5-ea27-4911-89b4-6bd160935722'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:11 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:11 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:12 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" returned: 0 in 0.658s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" released by "_copy_volume_from_snapshot" :: held 10.806s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-49c03ea6-0efa-4db9-b9e0-d7ec22fa9925-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" released by "_create_volume_from_snapshot" :: held 10.877s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.911s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-cbf193f4-214a-487d-a9d3-0658fcfe8382-63fbf27f-1e0b-4914-bd4c-53560be27c2a" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-cbf193f4-214a-487d-a9d3-0658fcfe8382-63fbf27f-1e0b-4914-bd4c-53560be27c2a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Creating volume 63fbf27f-1e0b-4914-bd4c-53560be27c2a from snapshot cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-63fbf27f-1e0b-4914-bd4c-53560be27c2a" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=129,cinder:SELECT=95,cinder:INSERT=31,cinder:DELETE=10 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-63fbf27f-1e0b-4914-bd4c-53560be27c2a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] snapshot: cbf193f4-214a-487d-a9d3-0658fcfe8382, volume: 63fbf27f-1e0b-4914-bd4c-53560be27c2a, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:15:12 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.677s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Deleted volume successfully. Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe615804-5f13-4770-b734-3b362c4149d8]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b7f415d8-c91e-43d8-9a29-726fa0e11a4b tempest-VolumesSnapshotTestJSON-1557404375 None] Lock "cinder-7aaed85b-1588-455b-a0da-89faf6a77176-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bff89ddd-a101-491d-9dba-c4172d8fbd1b tempest-GroupSnapshotsTest-550771466 None] Create group from source-snapshot-29f6be33-7d43-47e4-be19-dee48a03b6d0 completed successfully. Apr 29 18:15:12 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 Apr 29 18:15:12 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b404980-edf6-4e6f-8a4b-15ebb5b96194]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:13 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb Apr 29 18:15:13 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:13 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382" returned: 0 in 0.899s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fccc9585-df82-43d8-b866-bccba206b574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14bea00-fa0c-4887-9bc9-26fe859df826]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:13 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:15:13 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:13 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" returned: 0 in 0.844s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:13 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb Apr 29 18:15:13 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:14 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 0.836s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:14 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a Apr 29 18:15:14 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:14 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-50ff1020-b724-4c16-8f1c-bc0ea4cd1cdb" released by "delete_volume" :: held 1.580s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Created reservations ['e40a5601-4674-4874-b9f4-bd2595f9d47e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:14 devstack cinder-volume[84402]: WARNING cinder.quota [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1770453506 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1770453506, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:15:14 devstack cinder-volume[84402]: WARNING cinder.quota [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1770453506 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1770453506, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Created reservations ['e3639e27-c7d0-4b47-8779-b8be7db4dd2e', '135f1694-d953-476f-80f6-405582770c08', '4350de8f-f7e4-42fa-bb8a-f40e55d5fdc6', '0145c44a-b676-4b57-affa-f0922c6c1048'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:14 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:14 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 29f6be33-7d43-47e4-be19-dee48a03b6d0: deleting Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 29f6be33-7d43-47e4-be19-dee48a03b6d0: deleting {{(pid=84402) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-a6e41a67-9b50-4b3c-a162-889bbcead7f1" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-a6e41a67-9b50-4b3c-a162-889bbcead7f1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Deleting offline snapshot 49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 of volume a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] snapshot_file for this snap is: volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f979322f-9f71-4fdf-83af-82b611f83f63]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:15 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 Apr 29 18:15:15 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:16 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.321s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:16 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5aa521cf-195e-411f-b44b-539822b89a6c tempest-GroupSnapshotsTest-550771466 None] Delete group completed successfully. Apr 29 18:15:18 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" returned: 0 in 2.586s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:18 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6b999-a26a-4989-b753-964b29b0470d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:18 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:15:18 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:20 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 2.501s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:20 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 Apr 29 18:15:20 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:20 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a" returned: 0 in 6.640s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26dac1-d565-42fa-8845-42fad43311f9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:21 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:15:21 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:21 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" returned: 0 in 0.841s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:21 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925 Apr 29 18:15:21 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:22 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 1.060s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:15:22 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Converted 1024.00 MB image at 154.18 MB/s Apr 29 18:15:22 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a is being set with open permissions: ugo+rw Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:22 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a Apr 29 18:15:22 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:22 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1.49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" returned: 0 in 0.749s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-49c03ea6-0efa-4db9-b9e0-d7ec22fa9925" released by "_delete_snapshot" :: held 6.965s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-a6e41a67-9b50-4b3c-a162-889bbcead7f1" released by "delete_snapshot" :: held 7.012s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Flow 'volume_create_manager' (4c4f7198-2ff0-495a-a155-69c9254b11bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d7b69e-5193-4911-8bd5-464facf96262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d7b69e-5193-4911-8bd5-464facf96262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-599546066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b9d9cf-a0b4-465d-9704-86b7013b0ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabf7abf391242afb992391f163ecb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:22Z,use_quota=True,user_id='c4160fb287574336ac5eb92fee69c2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8467bf-9c84-42f5-96c7-31956758d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8467bf-9c84-42f5-96c7-31956758d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77091fb0-44d7-439b-9630-f914c0dde85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77091fb0-44d7-439b-9630-f914c0dde85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b9d9cf-a0b4-465d-9704-86b7013b0ccd', 'volume_name': 'volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11116975-9366-4261-a718-b4fd7ab039ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11116975-9366-4261-a718-b4fd7ab039ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4700ed2-aa55-4802-aaa8-9b99143fc68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd', 'volume_size': 1} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:22 devstack cinder-volume[84402]: WARNING cinder.quota [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1770453506 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1770453506, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] Created reservations ['5c5ee8bf-eb63-4662-a945-d8ee454cbb91', 'cf974e78-ae0e-4a96-a1d4-0bf59a849fae', '16333640-5874-400d-9b03-39502e092647', '1b3c14df-07e6-4b87-bd24-e5ae804b6abe'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-eb4fb321-373b-4890-86ef-ba234106e088 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 29f6be33-7d43-47e4-be19-dee48a03b6d0: deleted successfully Apr 29 18:15:22 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a" returned: 0 in 0.709s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-63fbf27f-1e0b-4914-bd4c-53560be27c2a" released by "_copy_volume_from_snapshot" :: held 10.380s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-cbf193f4-214a-487d-a9d3-0658fcfe8382-63fbf27f-1e0b-4914-bd4c-53560be27c2a" released by "_create_volume_from_snapshot" :: held 10.430s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.460s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-599546066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b9d9cf-a0b4-465d-9704-86b7013b0ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabf7abf391242afb992391f163ecb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:22Z,use_quota=True,user_id='c4160fb287574336ac5eb92fee69c2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Creating volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:22 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:22 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd 1073741824 Apr 29 18:15:22 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84525106-c47b-46ef-b47e-2019968bddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a', 'volume_size': 1, 'snapshot_id': 'cbf193f4-214a-487d-a9d3-0658fcfe8382'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ac2867-6d21-492b-bc12-1ee1f73f051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Volume volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a (63fbf27f-1e0b-4914-bd4c-53560be27c2a): created successfully Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ac2867-6d21-492b-bc12-1ee1f73f051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (bccccb88-b9e0-4903-902f-7c35b9977a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4ebaaafe-b694-4e61-9254-62cb3e341140 tempest-VolumeDependencyTests-543752546 None] Created volume successfully. Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-a6e41a67-9b50-4b3c-a162-889bbcead7f1" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-a6e41a67-9b50-4b3c-a162-889bbcead7f1" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[42da9223-85af-444c-83e4-046608fcd249]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:23 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:15:23 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-cbf193f4-214a-487d-a9d3-0658fcfe8382-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:23 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-cbf193f4-214a-487d-a9d3-0658fcfe8382-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-fccc9585-df82-43d8-b866-bccba206b574" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd 1073741824" returned: 0 in 0.934s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-fccc9585-df82-43d8-b866-bccba206b574" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-cbf193f4-214a-487d-a9d3-0658fcfe8382" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-cbf193f4-214a-487d-a9d3-0658fcfe8382" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Deleting offline snapshot cbf193f4-214a-487d-a9d3-0658fcfe8382 of volume fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] snapshot_file for this snap is: volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1def57-670d-40ee-8ed8-71a3f32f2eac]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:23 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd Apr 29 18:15:23 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:23 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 Apr 29 18:15:23 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:24 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 0.892s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:24 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1 Apr 29 18:15:24 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:24 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" returned: 0 in 0.794s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4700ed2-aa55-4802-aaa8-9b99143fc68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed64438-98c4-441d-8423-100752871161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:24 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382" returned: 0 in 0.864s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fccc9585-df82-43d8-b866-bccba206b574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Volume volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd (c4b9d9cf-a0b4-465d-9704-86b7013b0ccd): created successfully Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed64438-98c4-441d-8423-100752871161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Flow 'volume_create_manager' (4c4f7198-2ff0-495a-a155-69c9254b11bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[693524d0-7337-4f38-8617-ad0a8a2c4c83]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:24 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-97d22af7-03f5-4ed0-a9c8-5240d55a9242 tempest-VolumesSnapshotListTestJSON-629811554 None] Created volume successfully. Apr 29 18:15:24 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:15:24 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:24 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a6e41a67-9b50-4b3c-a162-889bbcead7f1" returned: 0 in 0.694s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-a6e41a67-9b50-4b3c-a162-889bbcead7f1" released by "delete_volume" :: held 1.663s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:24 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Created reservations ['077eddd3-fb81-4e9b-82fe-6c7f1585dbd7'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:24 devstack cinder-volume[84402]: WARNING cinder.db.sqlalchemy.api [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1770453506'] Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Created reservations ['6cdeecd9-aa38-4929-a466-0323dc774096', '1ffcba08-a7c9-4393-9166-7932b91325b4', 'f37f1a53-f05a-4cef-bacb-a6bd625e8b49', '19ce628a-b994-41f5-9620-d50dc81f5b44'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:25 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:25 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Acquiring lock "cinder-002734fc-5c1e-4a57-a57b-cbd21c765b46-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Lock "cinder-002734fc-5c1e-4a57-a57b-cbd21c765b46-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Acquiring lock "cinder-quobyte-002734fc-5c1e-4a57-a57b-cbd21c765b46" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Lock "cinder-quobyte-002734fc-5c1e-4a57-a57b-cbd21c765b46" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[524a88ef-5b93-4c3a-a317-e9a45eabd0c1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:25 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 0.779s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:25 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 Apr 29 18:15:25 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 Apr 29 18:15:25 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:25 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Creating offline snapshot 53575f03-c41e-4cb3-a8d5-3cddbf305383 of volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc4452-c2e8-4f01-ac8c-75b069179812]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:26 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.969s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-25434836-3187-4329-9409-0054f11289e2 tempest-GroupSnapshotsTest-550771466 None] Delete group completed successfully. Apr 29 18:15:26 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd Apr 29 18:15:26 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-476d576a-161f-4352-bab3-69a2792ed9a6 tempest-GroupSnapshotsTest-550771466 None] Group tempest-GroupSnapshotsTest-Group-908673067: creating Apr 29 18:15:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-476d576a-161f-4352-bab3-69a2792ed9a6 tempest-GroupSnapshotsTest-550771466 None] Group tempest-GroupSnapshotsTest-Group-908673067: created successfully Apr 29 18:15:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-476d576a-161f-4352-bab3-69a2792ed9a6 tempest-GroupSnapshotsTest-550771466 None] Create group completed successfully. Apr 29 18:15:26 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46" returned: 0 in 0.969s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:26 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46 Apr 29 18:15:26 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:26 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382" returned: 0 in 0.958s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:26 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382 Apr 29 18:15:26 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:26 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" returned: 0 in 0.787s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:26 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 1G Apr 29 18:15:26 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:26 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-002734fc-5c1e-4a57-a57b-cbd21c765b46" returned: 0 in 0.632s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Lock "cinder-quobyte-002734fc-5c1e-4a57-a57b-cbd21c765b46" released by "delete_volume" :: held 1.654s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Created reservations ['db254485-82f4-4700-bc0b-0e42f79b5593', '899ecfb0-9ba5-49f3-ad70-46301913cd0d', '6b9a1940-24a0-4eb7-b830-b9d57eea1721', '36183172-5b05-4015-b0e0-a6d5e5f04a65'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:27 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574.cbf193f4-214a-487d-a9d3-0658fcfe8382" returned: 0 in 0.635s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-cbf193f4-214a-487d-a9d3-0658fcfe8382" released by "_delete_snapshot" :: held 3.367s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-fccc9585-df82-43d8-b866-bccba206b574" released by "delete_snapshot" :: held 3.404s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:27 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:27 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Created reservations ['e9050d3f-a7eb-44e8-b3d8-ed59b72cf6cf', '33060a0d-26e1-4d59-9089-5f9dfa9b2fd1', '6acfacd1-ae82-441a-be9d-b3c823f38dcf', '534cacd6-f09d-4044-9a24-b78234e507d4'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:27 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Delete snapshot completed successfully. Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3ce64dfd-845c-4883-b1e4-d235917bf871 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-cbf193f4-214a-487d-a9d3-0658fcfe8382-delete_snapshot" released by "delete_snapshot" :: held 3.583s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:27 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 1G" returned: 0 in 0.853s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:27 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:15:27 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:27 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (cbcb874f-a20c-4e85-8976-7a2da8cd1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c14216-e605-4408-9160-265b48da88bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.768s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:27 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Deleted volume successfully. Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c14216-e605-4408-9160-265b48da88bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1234620252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61b5511c-5371-4f6c-8628-7d3a14753ff5,host='devstack@QuobyteHD#QuobyteHD',id=46c2aaf6-1408-4a4c-b789-68b60ae00e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:28Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8adaa1d9-1b14-40c9-a4d5-1e146e376db3),volume_type_id=8adaa1d9-1b14-40c9-a4d5-1e146e376db3)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a11fd-4680-46b1-a7b5-851856d6dc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a11fd-4680-46b1-a7b5-851856d6dc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59d33e-bdfa-4368-a06a-6d8da5b24ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59d33e-bdfa-4368-a06a-6d8da5b24ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c2aaf6-1408-4a4c-b789-68b60ae00e38', 'volume_name': 'volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb072ed-a838-4c72-8508-f069fb156372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb072ed-a838-4c72-8508-f069fb156372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c706eefe-c153-43ba-b864-15979a1c2a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Volume 46c2aaf6-1408-4a4c-b789-68b60ae00e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38', 'volume_size': 1} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-fccc9585-df82-43d8-b866-bccba206b574-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9aa099fe-2fd9-4234-863f-7cec7da8e6ef tempest-VolumesNegativeTest-549673198 None] Lock "cinder-002734fc-5c1e-4a57-a57b-cbd21c765b46-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-fccc9585-df82-43d8-b866-bccba206b574-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-fccc9585-df82-43d8-b866-bccba206b574" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-fccc9585-df82-43d8-b866-bccba206b574" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae387504-3518-4a86-8053-3918da203b87]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:28 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:15:28 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:28 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.787s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:28 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 is being set with open permissions: ugo+rw Apr 29 18:15:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:28 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:15:28 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:28 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 0.804s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:29 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574 Apr 29 18:15:29 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:29 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.652s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:29 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info Apr 29 18:15:29 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:29 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-fccc9585-df82-43d8-b866-bccba206b574" returned: 0 in 0.682s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-fccc9585-df82-43d8-b866-bccba206b574" released by "delete_volume" :: held 1.564s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Created reservations ['6676a795-4ea0-4ced-b549-b8d6d45185d4', '1ed514bc-7522-4d47-9d97-595d0bd88164', '1892672b-13fe-4bff-bd92-4f7997ffe8f8', '6bde3669-e07a-401e-bc3e-0d8ecabf1563'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:29 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info" returned: 0 in 0.645s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:29 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info is being set with open permissions: ugo+rw Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:29 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info Apr 29 18:15:29 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:29 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:29 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (59524d58-1bb3-4644-991b-618311c67410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a63259b-12a9-4714-9649-5a0b589e0f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a63259b-12a9-4714-9649-5a0b589e0f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1787305381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c574d9-bcc4-4f08-98a3-c370bacf4b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:30Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120619e4-f713-4231-bcd5-e094d2ea1c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120619e4-f713-4231-bcd5-e094d2ea1c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e833d33-73f3-4a03-ad66-eeacddf31321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e833d33-73f3-4a03-ad66-eeacddf31321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c574d9-bcc4-4f08-98a3-c370bacf4b03', 'volume_name': 'volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13786149-40a5-4d91-ad5e-1dd859ec08d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13786149-40a5-4d91-ad5e-1dd859ec08d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d79d3a-5360-4ed0-8be4-b033c195a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume d3c574d9-bcc4-4f08-98a3-c370bacf4b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03', 'volume_size': 1} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:30 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.info" returned: 0 in 0.775s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.624s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:30 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61b5511c-5371-4f6c-8628-7d3a14753ff5,created_at=2026-04-29T16:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1234620252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61b5511c-5371-4f6c-8628-7d3a14753ff5,host='devstack@QuobyteHD#QuobyteHD',id=46c2aaf6-1408-4a4c-b789-68b60ae00e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:28Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8adaa1d9-1b14-40c9-a4d5-1e146e376db3),volume_type_id=8adaa1d9-1b14-40c9-a4d5-1e146e376db3)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Creating volume 46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:30 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.801s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:30 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 1073741824 Apr 29 18:15:30 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:30 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Deleted volume successfully. Apr 29 18:15:30 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f3d1b878-ce57-4f38-bd7b-85ac9de7c5e5 tempest-VolumesSnapshotListTestJSON-629811554 None] Create snapshot completed successfully Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fe78245-ce86-4943-81c4-b6d067814610 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-fccc9585-df82-43d8-b866-bccba206b574-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (17c09469-e965-40a8-83f1-f63a5754f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6c020e-cb35-42a0-8db0-de81687814a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6c020e-cb35-42a0-8db0-de81687814a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-371318483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650bc9cc-bb13-4f71-9eca-8be44b7566e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c993358d93d54a18be9d06878977aead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:31Z,use_quota=True,user_id='15420469894746568998a04fc0c1d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d5b8ed-2f70-4d0b-b6d4-2cc4f03a3612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d5b8ed-2f70-4d0b-b6d4-2cc4f03a3612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed42f5c-347f-425e-9eef-edb8a3a2985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed42f5c-347f-425e-9eef-edb8a3a2985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'volume_name': 'volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7d95cf-c157-4f1e-a158-ee622894f443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7d95cf-c157-4f1e-a158-ee622894f443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09cba09-30e0-465d-853d-1198a539f09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Volume 650bc9cc-bb13-4f71-9eca-8be44b7566e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'volume_size': 1} Apr 29 18:15:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:31 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 1073741824" returned: 0 in 0.887s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:31 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 Apr 29 18:15:31 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:32 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38" returned: 0 in 0.580s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1787305381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c574d9-bcc4-4f08-98a3-c370bacf4b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:30Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Creating volume d3c574d9-bcc4-4f08-98a3-c370bacf4b03 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:32 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c706eefe-c153-43ba-b864-15979a1c2a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:32 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 1073741824 Apr 29 18:15:32 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb8c3a9-6737-4f41-8688-8bbc1a8f6564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:32 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Volume volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 (46c2aaf6-1408-4a4c-b789-68b60ae00e38): created successfully Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb8c3a9-6737-4f41-8688-8bbc1a8f6564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (cbcb874f-a20c-4e85-8976-7a2da8cd1039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2c90ff9d-0168-4274-9f9d-9f10ebf174cc tempest-GroupSnapshotsTest-550771466 None] Created volume successfully. Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (4f1fdda1-c536-414c-a1a5-d1942b88f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d602207-03e6-4b57-89ce-c1ab606e51a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d602207-03e6-4b57-89ce-c1ab606e51a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398951583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61b5511c-5371-4f6c-8628-7d3a14753ff5,host='devstack@QuobyteHD#QuobyteHD',id=3059575f-7f14-47b2-b465-8903ff1c827b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:33Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8adaa1d9-1b14-40c9-a4d5-1e146e376db3),volume_type_id=8adaa1d9-1b14-40c9-a4d5-1e146e376db3)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f6bf19-bd4c-4a2b-b077-7ce2e8795e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f6bf19-bd4c-4a2b-b077-7ce2e8795e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c91f0b-ef63-4ed2-8d85-32c47499fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c91f0b-ef63-4ed2-8d85-32c47499fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3059575f-7f14-47b2-b465-8903ff1c827b', 'volume_name': 'volume-3059575f-7f14-47b2-b465-8903ff1c827b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b2d875-564a-49cf-88c8-b34231ce78e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b2d875-564a-49cf-88c8-b34231ce78e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c0bda-459f-442d-b40b-44b9031359ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:32 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Volume 3059575f-7f14-47b2-b465-8903ff1c827b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3059575f-7f14-47b2-b465-8903ff1c827b', 'volume_size': 1} Apr 29 18:15:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:33 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 1073741824" returned: 0 in 0.839s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:33 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 Apr 29 18:15:33 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:33 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03" returned: 0 in 0.572s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-371318483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650bc9cc-bb13-4f71-9eca-8be44b7566e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c993358d93d54a18be9d06878977aead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:31Z,use_quota=True,user_id='15420469894746568998a04fc0c1d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Creating volume 650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:33 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d79d3a-5360-4ed0-8be4-b033c195a704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:33 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 1073741824 Apr 29 18:15:33 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4de9c5-41a7-44b1-a1c7-3819e4973343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:33 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 (d3c574d9-bcc4-4f08-98a3-c370bacf4b03): created successfully Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4de9c5-41a7-44b1-a1c7-3819e4973343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (59524d58-1bb3-4644-991b-618311c67410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-585ba3f6-c2d4-46f9-89d5-3d4add81c482 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created volume successfully. Apr 29 18:15:34 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 1073741824" returned: 0 in 0.734s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:34 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:15:34 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:35 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (41ca2fb8-58b2-4e98-8320-9f2f012af458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea7acfa-d191-412c-91e6-e7e47ad666be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.672s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.655s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea7acfa-d191-412c-91e6-e7e47ad666be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425536238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b2b626-5cec-450f-94f5-9ec72f5edcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:35Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8b2fa0-d5bd-4f27-a850-80e5dc66ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8b2fa0-d5bd-4f27-a850-80e5dc66ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a801da53-7abe-48e4-a1ae-480a59f6f42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a801da53-7abe-48e4-a1ae-480a59f6f42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b2b626-5cec-450f-94f5-9ec72f5edcb1', 'volume_name': 'volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041b08f3-51b1-481c-a74f-c6134b73bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041b08f3-51b1-481c-a74f-c6134b73bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c40f03-12a8-4054-9e73-10692f5aae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume a9b2b626-5cec-450f-94f5-9ec72f5edcb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1', 'volume_size': 1} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09cba09-30e0-465d-853d-1198a539f09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a3f939-06de-4cd6-bfc0-6f9f0dbd1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Creating offline snapshot 4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 of volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:15:35 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Volume volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 (650bc9cc-bb13-4f71-9eca-8be44b7566e8): created successfully Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a3f939-06de-4cd6-bfc0-6f9f0dbd1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (17c09469-e965-40a8-83f1-f63a5754f94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f3d6fe-7f66-4bcf-a096-aff70c052771]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:35 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0c875fb6-4c04-4363-9de0-5a66d4be84cd tempest-VolumeDependencyTests-543752546 None] Created volume successfully. Apr 29 18:15:35 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:15:35 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (e4f97d47-c911-4549-bec8-065925bd76df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d917f3-826f-4ad9-bc05-221b9ba9ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d917f3-826f-4ad9-bc05-221b9ba9ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131499638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4735de-9021-4b11-9e55-c79cc6946828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:35Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c082184-f502-47fc-8b12-2adaddd547ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c082184-f502-47fc-8b12-2adaddd547ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83a2d0d-366c-4309-92e7-644feee7ffb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83a2d0d-366c-4309-92e7-644feee7ffb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4735de-9021-4b11-9e55-c79cc6946828', 'volume_name': 'volume-da4735de-9021-4b11-9e55-c79cc6946828', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c6120e-4da6-47a0-955e-b570a2ddc952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c6120e-4da6-47a0-955e-b570a2ddc952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2680789-49af-4807-8262-6ff42a8d44d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume da4735de-9021-4b11-9e55-c79cc6946828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4735de-9021-4b11-9e55-c79cc6946828', 'volume_size': 1} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (947c937b-d482-4dd6-b723-35f86baa5597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83799d2-b1e1-4161-97a1-430f738f52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83799d2-b1e1-4161-97a1-430f738f52dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-952877969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e7cfd2-c999-4209-9a1f-8d7aea19afb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:36Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfb0133-a326-4b6e-a7f7-6b12bbaaaef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfb0133-a326-4b6e-a7f7-6b12bbaaaef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b651ff79-86f6-4f59-a251-8d2e590b2738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b651ff79-86f6-4f59-a251-8d2e590b2738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e7cfd2-c999-4209-9a1f-8d7aea19afb6', 'volume_name': 'volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2dbdf2-af73-4e07-a5c3-51067d53f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2dbdf2-af73-4e07-a5c3-51067d53f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01d6cfd-ef10-475f-bc9c-2f437500f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:35 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume 77e7cfd2-c999-4209-9a1f-8d7aea19afb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6', 'volume_size': 1} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:35 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:35 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:36 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.808s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:36 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 1G Apr 29 18:15:36 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (53323cb5-87a8-4e29-b75b-63fde0239587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8005aeb1-653a-43e6-9cb2-363b9adb20e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8005aeb1-653a-43e6-9cb2-363b9adb20e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434368223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c122769-962d-44d1-bace-4492371f05b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:36Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074d4612-0ff1-44d8-8a64-4be6b660cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074d4612-0ff1-44d8-8a64-4be6b660cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a9b5a0-eb1e-4944-b93b-5a1ce815f1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a9b5a0-eb1e-4944-b93b-5a1ce815f1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c122769-962d-44d1-bace-4492371f05b8', 'volume_name': 'volume-2c122769-962d-44d1-bace-4492371f05b8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4faaad-25bb-49ad-8742-e082e8fa3218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4faaad-25bb-49ad-8742-e082e8fa3218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf6e332-ed2c-45b2-9048-24680342a777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume 2c122769-962d-44d1-bace-4492371f05b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c122769-962d-44d1-bace-4492371f05b8', 'volume_size': 1} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (8892e6c8-8735-46a4-aa9d-65200d8f9f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6be180-e393-4b44-a76f-58b5bd80b3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6be180-e393-4b44-a76f-58b5bd80b3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258012796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb872b9-1566-4463-b816-0ac72876a5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:36Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c93e16b-15d8-4892-8546-8f7449cfd87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c93e16b-15d8-4892-8546-8f7449cfd87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21f8eaa-356a-495d-87d0-74960188dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21f8eaa-356a-495d-87d0-74960188dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb872b9-1566-4463-b816-0ac72876a5a5', 'volume_name': 'volume-bfb872b9-1566-4463-b816-0ac72876a5a5', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4115e59a-6a8a-4ef4-ba72-d9fceb9c2db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4115e59a-6a8a-4ef4-ba72-d9fceb9c2db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acdebda-4b15-4cbd-9be7-d47be72f3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume bfb872b9-1566-4463-b816-0ac72876a5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb872b9-1566-4463-b816-0ac72876a5a5', 'volume_size': 1} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:36 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.857s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (a4f9b3e7-762b-4ddc-ba05-0cfb59cd4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fdb8be-06e7-4b9a-87e2-da6d94237be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fdb8be-06e7-4b9a-87e2-da6d94237be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1293526825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d342a344-b314-4488-9152-35d83d1bdd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c993358d93d54a18be9d06878977aead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=650bc9cc-bb13-4f71-9eca-8be44b7566e8,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:37Z,use_quota=True,user_id='15420469894746568998a04fc0c1d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91168927-d2ab-47bc-a6eb-9b94a4fd9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91168927-d2ab-47bc-a6eb-9b94a4fd9670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263bba7c-8725-4a97-baeb-3c175f0bf915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263bba7c-8725-4a97-baeb-3c175f0bf915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd342a344-b314-4488-9152-35d83d1bdd55', 'volume_name': 'volume-d342a344-b314-4488-9152-35d83d1bdd55', 'volume_size': 1, 'source_volid': '650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aa0d01-604c-475c-b220-75c71465c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aa0d01-604c-475c-b220-75c71465c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3a6570-4c77-4d66-9e46-d5f510f98b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:36 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Volume d342a344-b314-4488-9152-35d83d1bdd55: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d342a344-b314-4488-9152-35d83d1bdd55', 'volume_size': 1, 'source_volid': '650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'source_volstatus': 'available'} Apr 29 18:15:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:37 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 1G" returned: 0 in 1.152s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:37 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:15:37 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:37 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.638s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:37 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 is being set with open permissions: ugo+rw Apr 29 18:15:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:37 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:15:37 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:38 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.617s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.389s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.607s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61b5511c-5371-4f6c-8628-7d3a14753ff5,created_at=2026-04-29T16:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398951583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61b5511c-5371-4f6c-8628-7d3a14753ff5,host='devstack@QuobyteHD#QuobyteHD',id=3059575f-7f14-47b2-b465-8903ff1c827b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:33Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8adaa1d9-1b14-40c9-a4d5-1e146e376db3),volume_type_id=8adaa1d9-1b14-40c9-a4d5-1e146e376db3)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Creating volume 3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:38 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:38 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b 1073741824 Apr 29 18:15:38 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:38 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-42cb053c-6b48-44be-9b54-b232b020dcd4 tempest-VolumesSnapshotListTestJSON-629811554 None] Create snapshot completed successfully Apr 29 18:15:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:39 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b 1073741824" returned: 0 in 0.807s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:39 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b Apr 29 18:15:39 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:39 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b" returned: 0 in 0.614s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425536238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b2b626-5cec-450f-94f5-9ec72f5edcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:35Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Creating volume a9b2b626-5cec-450f-94f5-9ec72f5edcb1 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:39 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:39 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 1073741824 Apr 29 18:15:39 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c0bda-459f-442d-b40b-44b9031359ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3059575f-7f14-47b2-b465-8903ff1c827b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ec20ed-4c78-4a2d-9a63-c3f9a2b1d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:39 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Volume volume-3059575f-7f14-47b2-b465-8903ff1c827b (3059575f-7f14-47b2-b465-8903ff1c827b): created successfully Apr 29 18:15:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ec20ed-4c78-4a2d-9a63-c3f9a2b1d75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (4f1fdda1-c536-414c-a1a5-d1942b88f544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:40 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3c183b0a-49db-4469-8166-8e2dfffbe041 tempest-GroupSnapshotsTest-550771466 None] Created volume successfully. Apr 29 18:15:40 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=120,cinder:SELECT=120,cinder:INSERT=23,cinder:DELETE=8 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:15:40 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a3699a6d-7f6e-49e3-a5b9-683e97af106a tempest-GroupSnapshotsTest-550771466 None] Update group completed successfully. Apr 29 18:15:40 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 1073741824" returned: 0 in 0.841s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:40 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 Apr 29 18:15:40 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:41 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1" returned: 0 in 0.588s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.938s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131499638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4735de-9021-4b11-9e55-c79cc6946828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:35Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Creating volume da4735de-9021-4b11-9e55-c79cc6946828 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:41 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c40f03-12a8-4054-9e73-10692f5aae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64229431-9191-4dbe-8f38-133e35374e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:41 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 1073741824 Apr 29 18:15:41 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 (a9b2b626-5cec-450f-94f5-9ec72f5edcb1): created successfully Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64229431-9191-4dbe-8f38-133e35374e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (41ca2fb8-58b2-4e98-8320-9f2f012af458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b6c6ea9c-6322-4c37-bf9d-aa24fe27beb9 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created volume successfully. Apr 29 18:15:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5cb9e9c4-cc4e-4fcc-b84f-bfa6fb02d050 tempest-GroupSnapshotsTest-550771466 None] Update group completed successfully. Apr 29 18:15:42 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 1073741824" returned: 0 in 0.807s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:42 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 Apr 29 18:15:42 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:42 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828" returned: 0 in 0.609s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.042s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-952877969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e7cfd2-c999-4209-9a1f-8d7aea19afb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:36Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Creating volume 77e7cfd2-c999-4209-9a1f-8d7aea19afb6 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:42 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:42 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 1073741824 Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2680789-49af-4807-8262-6ff42a8d44d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4735de-9021-4b11-9e55-c79cc6946828', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:42 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5440432-ee7e-47c6-933e-b122729c3fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume volume-da4735de-9021-4b11-9e55-c79cc6946828 (da4735de-9021-4b11-9e55-c79cc6946828): created successfully Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5440432-ee7e-47c6-933e-b122729c3fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (e4f97d47-c911-4549-bec8-065925bd76df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8f47d3ac-dbba-4270-b2db-8726e8a8b635 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created volume successfully. Apr 29 18:15:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-09289d22-1a9b-441a-9f69-f6f22989cdf1 tempest-GroupSnapshotsTest-550771466 None] Update group completed successfully. Apr 29 18:15:43 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 1073741824" returned: 0 in 0.839s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:43 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 Apr 29 18:15:43 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e4c262b6-d380-4f91-9167-6bef5c678ffd tempest-GroupSnapshotsTest-550771466 None] Update group completed successfully. Apr 29 18:15:44 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6" returned: 0 in 0.589s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434368223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c122769-962d-44d1-bace-4492371f05b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:36Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Creating volume 2c122769-962d-44d1-bace-4492371f05b8 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:44 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01d6cfd-ef10-475f-bc9c-2f437500f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90e510d-d167-442f-827f-14b23808a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:44 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 1073741824 Apr 29 18:15:44 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:44 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 (77e7cfd2-c999-4209-9a1f-8d7aea19afb6): created successfully Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90e510d-d167-442f-827f-14b23808a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (947c937b-d482-4dd6-b723-35f86baa5597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7a3be90c-71c9-4b03-b579-6037702da8fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created volume successfully. Apr 29 18:15:45 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 1073741824" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:45 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 Apr 29 18:15:45 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:45 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] GroupSnapshot 65a0fed4-8ddc-4ac4-b3c2-41ca989b0c22: creating. Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Group snapshot 65a0fed4-8ddc-4ac4-b3c2-41ca989b0c22: creating. {{(pid=84402) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:45 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8" returned: 0 in 0.640s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.105s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258012796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb872b9-1566-4463-b816-0ac72876a5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c323677284f8faa0a4dab4a0c63a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:15:36Z,use_quota=True,user_id='9b5c1a049bd9480694660fa773a35d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Creating volume bfb872b9-1566-4463-b816-0ac72876a5a5 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:15:45 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:45 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 1073741824 Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf6e332-ed2c-45b2-9048-24680342a777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c122769-962d-44d1-bace-4492371f05b8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:45 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44fd47d-ce11-46b2-b95b-930e09936e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:45 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume volume-2c122769-962d-44d1-bace-4492371f05b8 (2c122769-962d-44d1-bace-4492371f05b8): created successfully Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44fd47d-ce11-46b2-b95b-930e09936e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (53323cb5-87a8-4e29-b75b-63fde0239587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:45 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-41b70ef8-ab3b-425e-85b2-2b7b6b0cd425 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created volume successfully. Apr 29 18:15:46 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 1073741824" returned: 0 in 0.789s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:46 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 Apr 29 18:15:46 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:47 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.222s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:47 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Cloning volume 650bc9cc-bb13-4f71-9eca-8be44b7566e8 to volume d342a344-b314-4488-9152-35d83d1bdd55 Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acdebda-4b15-4cbd-9be7-d47be72f3000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb872b9-1566-4463-b816-0ac72876a5a5', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c3ead2-757c-4303-9047-a5efab4486aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Creating offline snapshot 0780d5f7-d1f2-48e0-86f5-0665ad1461fe of volume 650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:15:47 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Volume volume-bfb872b9-1566-4463-b816-0ac72876a5a5 (bfb872b9-1566-4463-b816-0ac72876a5a5): created successfully Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c3ead2-757c-4303-9047-a5efab4486aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Flow 'volume_create_manager' (8892e6c8-8735-46a4-aa9d-65200d8f9f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b036a7c-4c80-4bb7-8806-1e6b3b73abb3]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9feb0a34-c8cc-4103-9eea-4dba2ffc51b0 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created volume successfully. Apr 29 18:15:47 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:15:47 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:47 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.713s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:47 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe 1G Apr 29 18:15:47 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-bfb872b9-1566-4463-b816-0ac72876a5a5-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-bfb872b9-1566-4463-b816-0ac72876a5a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-quobyte-bfb872b9-1566-4463-b816-0ac72876a5a5" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-bfb872b9-1566-4463-b816-0ac72876a5a5" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cf4310-4e01-4c2d-9715-a407290a2172]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:48 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 Apr 29 18:15:48 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:48 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe 1G" returned: 0 in 0.817s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:48 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe Apr 29 18:15:48 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:49 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5" returned: 0 in 0.715s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:49 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5 Apr 29 18:15:49 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:49 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe" returned: 0 in 0.623s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:49 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe is being set with open permissions: ugo+rw Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:49 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe Apr 29 18:15:49 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:49 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bfb872b9-1566-4463-b816-0ac72876a5a5" returned: 0 in 0.619s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-bfb872b9-1566-4463-b816-0ac72876a5a5" released by "delete_volume" :: held 1.386s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created reservations ['201d6480-58d1-4f3b-a092-abd7b57f1997', '1a486229-f1cf-4116-bf76-d05558681f2f', 'cf85778e-feb9-401c-827c-c07b063c9307', '9b943eaf-108e-41e8-9120-ffc3a054b5be'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:50 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:50 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:50 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe" returned: 0 in 0.635s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:50 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info Apr 29 18:15:50 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:50 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:50 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Deleted volume successfully. Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-47274f0a-2033-4cf7-9823-1c02f8a87531 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-bfb872b9-1566-4463-b816-0ac72876a5a5-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-2c122769-962d-44d1-bace-4492371f05b8-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-2c122769-962d-44d1-bace-4492371f05b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-quobyte-2c122769-962d-44d1-bace-4492371f05b8" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:50 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:50 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info is being set with open permissions: ugo+rw Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-2c122769-962d-44d1-bace-4492371f05b8" acquired by "delete_volume" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:50 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info Apr 29 18:15:50 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c28490-b64f-4cc4-9f4a-178678bef724]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:50 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 Apr 29 18:15:50 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:51 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.info" returned: 0 in 0.597s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-d342a344-b314-4488-9152-35d83d1bdd55" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-d342a344-b314-4488-9152-35d83d1bdd55" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] snapshot: 0780d5f7-d1f2-48e0-86f5-0665ad1461fe, volume: d342a344-b314-4488-9152-35d83d1bdd55, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60df5cd-ea1e-437a-8ee3-ae0db9b4331e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:51 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8" returned: 0 in 0.692s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:51 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe Apr 29 18:15:51 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:51 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8 Apr 29 18:15:51 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:52 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2c122769-962d-44d1-bace-4492371f05b8" returned: 0 in 0.596s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-2c122769-962d-44d1-bace-4492371f05b8" released by "delete_volume" :: held 1.345s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:52 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe" returned: 0 in 0.731s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created reservations ['05ed5e0d-ccee-42f9-ad98-1b4e9675a4c8', '06c5942f-49f8-4cdd-be4a-4aa7fb411b86', 'c0df20d5-174f-431c-a0ae-30eb518844be', '3f112c47-68a0-43a9-9c7b-188fc15439be'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc620c26-9170-41eb-bfed-e1ea51713186]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:52 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:52 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:52 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:15:52 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:52 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.614s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Deleted volume successfully. Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-937944fd-59fe-4bd4-9779-8a59047e3476 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-2c122769-962d-44d1-bace-4492371f05b8-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:52 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.752s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-77e7cfd2-c999-4209-9a1f-8d7aea19afb6-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:52 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 Apr 29 18:15:52 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-77e7cfd2-c999-4209-9a1f-8d7aea19afb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-quobyte-77e7cfd2-c999-4209-9a1f-8d7aea19afb6" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-77e7cfd2-c999-4209-9a1f-8d7aea19afb6" acquired by "delete_volume" :: waited 0.012s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:53 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a74dcb3-887e-424d-812f-1cb1012a3959]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:53 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 Apr 29 18:15:53 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:53 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6" returned: 0 in 0.930s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:54 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6 Apr 29 18:15:54 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:54 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-77e7cfd2-c999-4209-9a1f-8d7aea19afb6" returned: 0 in 0.867s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-77e7cfd2-c999-4209-9a1f-8d7aea19afb6" released by "delete_volume" :: held 1.853s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:54 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created reservations ['db8d453f-7647-41e1-885d-ff4ff73b5d41', 'a99b3677-8a51-4346-a448-13a2196d501c', 'f6dd4b60-2459-4083-9500-078c488ceb4a', '1c91c0b2-627c-423d-ab9f-ab817c916d3c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:55 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:55 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-da4735de-9021-4b11-9e55-c79cc6946828-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-da4735de-9021-4b11-9e55-c79cc6946828-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-quobyte-da4735de-9021-4b11-9e55-c79cc6946828" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-da4735de-9021-4b11-9e55-c79cc6946828" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667970a-9125-42ec-869e-2183057d7b20]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:55 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 Apr 29 18:15:55 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:56 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.291s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:56 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:56 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Deleted volume successfully. Apr 29 18:15:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-386006d3-49a3-435d-9a60-2e6f338da7fe tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-77e7cfd2-c999-4209-9a1f-8d7aea19afb6-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:57 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828" returned: 0 in 2.235s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:57 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828 Apr 29 18:15:57 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:58 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55" returned: 0 in 5.126s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1454d9a-3e84-4182-9962-5298ef66037f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:58 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:15:58 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:58 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-da4735de-9021-4b11-9e55-c79cc6946828" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-da4735de-9021-4b11-9e55-c79cc6946828" released by "delete_volume" :: held 2.954s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created reservations ['062b1007-b4aa-442e-976c-e52d35bab46b', 'a46fa64b-d009-4983-aca3-9af1dddd5335', '173f0f61-70b3-4812-b29d-192cf4f5092b', 'ade9c73f-59c9-4038-a33c-89fd1fb1a288'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:58 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:15:58 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-a9b2b626-5cec-450f-94f5-9ec72f5edcb1-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-a9b2b626-5cec-450f-94f5-9ec72f5edcb1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:58 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.957s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:15:58 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Converted 1024.00 MB image at 199.73 MB/s Apr 29 18:15:58 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 is being set with open permissions: ugo+rw Apr 29 18:15:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-quobyte-a9b2b626-5cec-450f-94f5-9ec72f5edcb1" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:59 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 Apr 29 18:15:59 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-a9b2b626-5cec-450f-94f5-9ec72f5edcb1" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e4200-1fa5-4ed5-914f-cfc7c74041c4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:59 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.604s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:15:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Deleted volume successfully. Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cc578497-1a91-489e-9055-648a2f5de568 tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-da4735de-9021-4b11-9e55-c79cc6946828-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:59 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 Apr 29 18:15:59 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:59 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55" returned: 0 in 0.634s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-d342a344-b314-4488-9152-35d83d1bdd55" released by "_copy_volume_from_snapshot" :: held 8.284s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-0780d5f7-d1f2-48e0-86f5-0665ad1461fe" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-0780d5f7-d1f2-48e0-86f5-0665ad1461fe" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Deleting offline snapshot 0780d5f7-d1f2-48e0-86f5-0665ad1461fe of volume 650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] snapshot_file for this snap is: volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a23ea7-cb9a-4a7c-9cbb-1581de6b32ba]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:59 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1" returned: 0 in 0.725s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:15:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:15:59 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1 Apr 29 18:15:59 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:15:59 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe Apr 29 18:15:59 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:00 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a9b2b626-5cec-450f-94f5-9ec72f5edcb1" returned: 0 in 0.612s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-a9b2b626-5cec-450f-94f5-9ec72f5edcb1" released by "delete_volume" :: held 1.390s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:00 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe" returned: 0 in 0.735s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[76720152-9d10-4307-a8cb-999695187c6e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created reservations ['dffc5771-fd52-4d3c-aedb-118df2bf4e4a', 'a2004746-ecaa-4d1b-885d-a1264cbeb4fe', '576ae288-12fe-4044-adc8-01fdc7e9c39a', 'e4be4be8-e86e-44f9-9529-fee76c31829d'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:00 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:16:00 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:00 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:00 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-d3c574d9-bcc4-4f08-98a3-c370bacf4b03-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:01 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.616s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-d3c574d9-bcc4-4f08-98a3-c370bacf4b03-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:01 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Deleted volume successfully. Apr 29 18:16:01 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.749s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:01 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe Apr 29 18:16:01 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-01660a46-fb31-4068-81e5-9726886a397f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-a9b2b626-5cec-450f-94f5-9ec72f5edcb1-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "cinder-quobyte-d3c574d9-bcc4-4f08-98a3-c370bacf4b03" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-d3c574d9-bcc4-4f08-98a3-c370bacf4b03" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[787450e0-4391-44be-be12-2cfce6086a43]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:01 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 Apr 29 18:16:01 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:01 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe" returned: 0 in 0.726s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:01 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe Apr 29 18:16:01 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:02 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03" returned: 0 in 0.771s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:02 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03 Apr 29 18:16:02 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:02 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8.0780d5f7-d1f2-48e0-86f5-0665ad1461fe" returned: 0 in 0.647s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-0780d5f7-d1f2-48e0-86f5-0665ad1461fe" released by "_delete_snapshot" :: held 2.969s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.495s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 23.746s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:02 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3a6570-4c77-4d66-9e46-d5f510f98b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d342a344-b314-4488-9152-35d83d1bdd55', 'volume_size': 1, 'source_volid': '650bc9cc-bb13-4f71-9eca-8be44b7566e8', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ba97a0-e874-4e54-9b82-6e5cb9658239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d3c574d9-bcc4-4f08-98a3-c370bacf4b03" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Creating offline snapshot f846e535-6079-427b-9efa-5770273dcf64 of volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-quobyte-d3c574d9-bcc4-4f08-98a3-c370bacf4b03" released by "delete_volume" :: held 1.497s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Volume volume-d342a344-b314-4488-9152-35d83d1bdd55 (d342a344-b314-4488-9152-35d83d1bdd55): created successfully Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ba97a0-e874-4e54-9b82-6e5cb9658239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Flow 'volume_create_manager' (a4f9b3e7-762b-4ddc-ba05-0cfb59cd4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a84b80-3611-451c-b474-8f67140f731b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4790f9d8-dbe8-4f5a-a4da-a5752173b64b tempest-VolumeDependencyTests-543752546 None] Created volume successfully. Apr 29 18:16:02 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Created reservations ['db624b7d-331b-417f-a706-9409fe189275', '8ccc7281-b209-4444-b4a8-ffb0433c6a78', '9cd6a7d3-dd47-403b-8f2c-76f818a47ee5', 'a248c157-83d4-4ca3-901b-735c58aa5ad7'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:02 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:16:02 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:03 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:03 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:03 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:03 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 1G Apr 29 18:16:03 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:03 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.687s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:03 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Deleted volume successfully. Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b2b0acaa-9f61-413c-9022-847d47fd3b9f tempest-CreateVolumesFromSourceVolumeTest-699809025 None] Lock "cinder-d3c574d9-bcc4-4f08-98a3-c370bacf4b03-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-650bc9cc-bb13-4f71-9eca-8be44b7566e8-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-650bc9cc-bb13-4f71-9eca-8be44b7566e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-650bc9cc-bb13-4f71-9eca-8be44b7566e8" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-650bc9cc-bb13-4f71-9eca-8be44b7566e8" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:04 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[043790de-1e57-483d-be17-b0e431cc3a20]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:04 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:16:04 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:04 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 1G" returned: 0 in 1.185s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:04 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 Apr 29 18:16:04 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:04 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.864s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:04 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8 Apr 29 18:16:04 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:05 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64" returned: 0 in 0.772s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:05 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 is being set with open permissions: ugo+rw Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:05 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 Apr 29 18:16:05 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:05 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-650bc9cc-bb13-4f71-9eca-8be44b7566e8" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-650bc9cc-bb13-4f71-9eca-8be44b7566e8" released by "delete_volume" :: held 1.693s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Created reservations ['0115f0fd-2f92-4c16-b074-bebd53ba79f6', '2395aaa8-25e6-4afe-8b20-7ffd32834de2', '5d07f9f3-9846-4f32-af62-e1e8683de174', '0a66f869-f729-4e52-931c-e92a9e54a62a'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:05 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:05 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:06 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-d342a344-b314-4488-9152-35d83d1bdd55-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64" returned: 0 in 0.692s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-d342a344-b314-4488-9152-35d83d1bdd55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.681s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Creating offline snapshot b59cecae-3306-44db-8613-a8cbdedbd75d of volume 46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:16:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7b1a423c-0ef6-4f7c-b097-756d4cd25eb8 tempest-VolumesSnapshotListTestJSON-629811554 None] Create snapshot completed successfully Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-d342a344-b314-4488-9152-35d83d1bdd55" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3bbcdd-876c-4deb-9035-bbd30aa33a1c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-d342a344-b314-4488-9152-35d83d1bdd55" acquired by "delete_volume" :: waited 0.039s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ff386-71f6-430b-b3f7-efef54b03ece]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:06 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.681s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:06 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 Apr 29 18:16:06 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Deleted volume successfully. Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-24901838-fc6e-40a8-810e-b4a45ace4b82 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-650bc9cc-bb13-4f71-9eca-8be44b7566e8-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:06 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 Apr 29 18:16:06 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Flow 'volume_create_manager' (35a4d96d-4b43-44e1-bf94-c4d8aec37da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd00babb-acd4-4d6f-8142-9b0fea91e862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd00babb-acd4-4d6f-8142-9b0fea91e862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40cc180-fa48-4d94-95ef-05555f4d013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ab4150bc42467f9b662add671b5cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:07Z,use_quota=True,user_id='cdbfc0109e24428b8a1d5a8ab735de09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4a4977-c787-4afa-b8b5-f6ac576fc8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4a4977-c787-4afa-b8b5-f6ac576fc8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b44e54c-bf64-4cbc-9ee9-bc5974bc3b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b44e54c-bf64-4cbc-9ee9-bc5974bc3b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40cc180-fa48-4d94-95ef-05555f4d013a', 'volume_name': 'volume-c40cc180-fa48-4d94-95ef-05555f4d013a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cabd402-4477-4d99-928c-77e4c2583516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cabd402-4477-4d99-928c-77e4c2583516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e6e19a-6dac-42fd-89d4-a43520013795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Volume c40cc180-fa48-4d94-95ef-05555f4d013a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40cc180-fa48-4d94-95ef-05555f4d013a', 'volume_size': 1} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:07 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55" returned: 0 in 0.723s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:07 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55 Apr 29 18:16:07 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:07 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38" returned: 0 in 0.901s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:07 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d 1G Apr 29 18:16:07 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:07 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d342a344-b314-4488-9152-35d83d1bdd55" returned: 0 in 0.583s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-d342a344-b314-4488-9152-35d83d1bdd55" released by "delete_volume" :: held 1.364s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Created reservations ['be26408f-0be8-483f-9306-426f3a055fd3', '3b25d719-0b24-4aea-be98-5addb73a1335', '1b86f66b-5456-4eac-8408-2ad9282d932b', '20a53dcf-6f17-4dae-ab7c-45c78f581c2e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:07 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:07 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-f846e535-6079-427b-9efa-5770273dcf64-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-f846e535-6079-427b-9efa-5770273dcf64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-f846e535-6079-427b-9efa-5770273dcf64" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-f846e535-6079-427b-9efa-5770273dcf64" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Deleting offline snapshot f846e535-6079-427b-9efa-5770273dcf64 of volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] snapshot_file for this snap is: volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63efc44-8e03-4b29-b122-e8e46b90ac82]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:08 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d 1G" returned: 0 in 0.922s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:08 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d Apr 29 18:16:08 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:08 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 Apr 29 18:16:08 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:08 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-63fbf27f-1e0b-4914-bd4c-53560be27c2a-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.639s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:08 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Deleted volume successfully. Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-63fbf27f-1e0b-4914-bd4c-53560be27c2a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bfa7e3b8-971f-4dfe-9775-c309055b4316 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-d342a344-b314-4488-9152-35d83d1bdd55-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "cinder-quobyte-63fbf27f-1e0b-4914-bd4c-53560be27c2a" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-63fbf27f-1e0b-4914-bd4c-53560be27c2a" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafcaa3e-54a8-4bbf-aa37-d31f3659c949]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:08 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a Apr 29 18:16:08 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:08 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d" returned: 0 in 0.661s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:08 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:08 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d Apr 29 18:16:08 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:08 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64" returned: 0 in 0.843s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e088e-9fcf-4118-9089-f91972101164]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:09 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:16:09 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:09 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:09 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a" returned: 0 in 0.780s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d" returned: 0 in 0.627s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:09 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a Apr 29 18:16:09 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:09 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info Apr 29 18:16:09 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:09 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.794s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:09 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 Apr 29 18:16:09 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:10 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-63fbf27f-1e0b-4914-bd4c-53560be27c2a" returned: 0 in 0.665s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-quobyte-63fbf27f-1e0b-4914-bd4c-53560be27c2a" released by "delete_volume" :: held 1.501s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:10 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info" returned: 0 in 0.650s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:10 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:10 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info Apr 29 18:16:10 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Created reservations ['01cebcf0-8758-4119-81c0-8afcdb2bd154', '80a1e426-1608-4622-95da-be842240052e', '76bcdd4d-d731-410f-ba2e-474ce3e75ba5', '98031872-3073-4783-89a3-ab9e9ef7d423'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:10 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:10 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:10 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64" returned: 0 in 0.814s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:10 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64 Apr 29 18:16:10 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:10 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.info" returned: 0 in 0.685s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Creating offline snapshot faa58f76-4516-4045-bc32-e815f3a24c54 of volume 3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[890f2718-2f4a-4e8d-9d06-6c59cd4bc195]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:10 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.672s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Deleted volume successfully. Apr 29 18:16:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-52d9ec63-b09c-43e0-bcb7-56b6824d0681 tempest-VolumeDependencyTests-543752546 None] Lock "cinder-63fbf27f-1e0b-4914-bd4c-53560be27c2a-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:11 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b Apr 29 18:16:11 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:11 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.f846e535-6079-427b-9efa-5770273dcf64" returned: 0 in 0.668s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-f846e535-6079-427b-9efa-5770273dcf64" released by "_delete_snapshot" :: held 3.270s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" released by "delete_snapshot" :: held 3.297s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Created reservations ['4c5f7a0a-84f4-4a19-a0d4-0598774ffe89', '08da8985-b1a0-461b-96cd-13c302f8114d', 'b6ef742b-f451-4d56-b68d-0d1ac321205c', 'efb9708a-21cc-4a29-9e0d-0c034b3aeca8'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Delete snapshot completed successfully. Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6d675620-d26a-4081-be0d-9632295abf53 tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-f846e535-6079-427b-9efa-5770273dcf64-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:11 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b" returned: 0 in 0.813s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:11 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 1G Apr 29 18:16:11 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Deleting offline snapshot 4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 of volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] snapshot_file for this snap is: volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f325895-d2e2-4256-ba71-28c38810fa90]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:12 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:16:12 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:12 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 1G" returned: 0 in 0.848s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3059575f-7f14-47b2-b465-8903ff1c827b -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:12 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3059575f-7f14-47b2-b465-8903ff1c827b -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 Apr 29 18:16:12 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:13 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.794s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:13 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3059575f-7f14-47b2-b465-8903ff1c827b -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54" returned: 0 in 0.651s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:13 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025f456-fc12-4939-9822-49b50077c8d5]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:13 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 Apr 29 18:16:13 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:13 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:16:13 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:13 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54" returned: 0 in 0.598s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=169,cinder:SELECT=135,cinder:INSERT=46,cinder:DELETE=12 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:13 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info Apr 29 18:16:13 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:13 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.710s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:13 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:16:13 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:14 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info" returned: 0 in 0.618s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:14 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:16:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:14 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info Apr 29 18:16:14 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:14 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.751s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:14 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3 Apr 29 18:16:14 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:15 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.info" returned: 0 in 0.592s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.056s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40cc180-fa48-4d94-95ef-05555f4d013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ab4150bc42467f9b662add671b5cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:07Z,use_quota=True,user_id='cdbfc0109e24428b8a1d5a8ab735de09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Creating volume c40cc180-fa48-4d94-95ef-05555f4d013a {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:15 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:15 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a 1073741824 Apr 29 18:16:15 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1de53ed6-95dd-4049-a878-4728f62ae449 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 65a0fed4-8ddc-4ac4-b3c2-41ca989b0c22: created successfully Apr 29 18:16:15 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" returned: 0 in 0.615s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3" released by "_delete_snapshot" :: held 2.969s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" released by "delete_snapshot" :: held 2.995s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Created reservations ['fb273234-27a3-4514-86a4-6395d9e1634e', 'b78d3ed0-6d26-4007-9c85-95de00400e6b', '1e645c0f-c56a-4acb-9231-f313c4e5c380', '43a8b030-c4d6-4ef7-92c3-300305566b39'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Delete snapshot completed successfully. Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e0d154b6-8d65-442a-99e2-5652ad2ac48c tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-4e03672f-2ea0-4a96-bcde-9c7eb0dad4b3-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:15 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a 1073741824" returned: 0 in 0.740s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:15 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a Apr 29 18:16:15 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 65a0fed4-8ddc-4ac4-b3c2-41ca989b0c22: deleting Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 65a0fed4-8ddc-4ac4-b3c2-41ca989b0c22: deleting {{(pid=84402) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-46c2aaf6-1408-4a4c-b789-68b60ae00e38" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-46c2aaf6-1408-4a4c-b789-68b60ae00e38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-b59cecae-3306-44db-8613-a8cbdedbd75d" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-b59cecae-3306-44db-8613-a8cbdedbd75d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Deleting offline snapshot b59cecae-3306-44db-8613-a8cbdedbd75d of volume 46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] snapshot_file for this snap is: volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[050abb84-7c45-4499-8c93-3be73fba0d3e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:16 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d Apr 29 18:16:16 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:16 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e6e19a-6dac-42fd-89d4-a43520013795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40cc180-fa48-4d94-95ef-05555f4d013a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ea91c7-59d6-4523-878d-1121669e0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:16 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Volume volume-c40cc180-fa48-4d94-95ef-05555f4d013a (c40cc180-fa48-4d94-95ef-05555f4d013a): created successfully Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ea91c7-59d6-4523-878d-1121669e0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Flow 'volume_create_manager' (35a4d96d-4b43-44e1-bf94-c4d8aec37da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-53575f03-c41e-4cb3-a8d5-3cddbf305383-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8cc2cf4c-3acd-4ec7-af68-16f0847f9b22 tempest-CinderUnicodeTest-484019977 None] Created volume successfully. Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-53575f03-c41e-4cb3-a8d5-3cddbf305383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-53575f03-c41e-4cb3-a8d5-3cddbf305383" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-53575f03-c41e-4cb3-a8d5-3cddbf305383" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Deleting offline snapshot 53575f03-c41e-4cb3-a8d5-3cddbf305383 of volume c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] snapshot_file for this snap is: volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b9fcd-f966-44cc-9447-7bc833aa8587]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:16 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:16:16 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:16 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d" returned: 0 in 0.761s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f7eab2-4d5d-461c-b27e-e750805958ea]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Flow 'volume_create_manager' (ab0173a4-0fa6-4c89-9cdb-7681b53ca0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:17 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 Apr 29 18:16:17 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e1d580-a694-48c8-8dd2-34f5528c05ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e1d580-a694-48c8-8dd2-34f5528c05ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-813999638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607f1ad4-3ae8-41a7-9ce9-770bd8ee214c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ab4150bc42467f9b662add671b5cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:17Z,use_quota=True,user_id='cdbfc0109e24428b8a1d5a8ab735de09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ed362b-0941-4a11-acd3-25f22c673b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ed362b-0941-4a11-acd3-25f22c673b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aece44b6-3a49-489e-abe3-aec9896e2ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aece44b6-3a49-489e-abe3-aec9896e2ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607f1ad4-3ae8-41a7-9ce9-770bd8ee214c', 'volume_name': 'volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410fcdc8-3bd8-448f-b53a-e2ae803ca390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410fcdc8-3bd8-448f-b53a-e2ae803ca390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90bd221-beee-4d67-9251-7e29278be180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:17 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Volume 607f1ad4-3ae8-41a7-9ce9-770bd8ee214c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c', 'volume_size': 1} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-813999638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607f1ad4-3ae8-41a7-9ce9-770bd8ee214c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ab4150bc42467f9b662add671b5cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:17Z,use_quota=True,user_id='cdbfc0109e24428b8a1d5a8ab735de09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Creating volume 607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:17 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:17 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c 1073741824 Apr 29 18:16:17 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:17 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.759s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32872bf-0332-43da-858f-346f0da5979f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:17 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd Apr 29 18:16:17 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:17 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:17 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d Apr 29 18:16:17 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:18 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c 1073741824" returned: 0 in 0.812s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:18 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c Apr 29 18:16:18 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:18 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" returned: 0 in 0.775s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:18 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:16:18 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:18 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d" returned: 0 in 0.699s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:18 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d Apr 29 18:16:18 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:18 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" returned: 0 in 0.636s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90bd221-beee-4d67-9251-7e29278be180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d309aec5-e218-4076-8f99-3b9c525993c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:18 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Volume volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c (607f1ad4-3ae8-41a7-9ce9-770bd8ee214c): created successfully Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d309aec5-e218-4076-8f99-3b9c525993c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Flow 'volume_create_manager' (ab0173a4-0fa6-4c89-9cdb-7681b53ca0c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:18 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-695775de-71c1-48db-8353-c84b90f3b523 tempest-CinderUnicodeTest-484019977 None] Created volume successfully. Apr 29 18:16:18 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:18 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383 Apr 29 18:16:18 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:19 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38.b59cecae-3306-44db-8613-a8cbdedbd75d" returned: 0 in 0.602s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-b59cecae-3306-44db-8613-a8cbdedbd75d" released by "_delete_snapshot" :: held 2.960s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-46c2aaf6-1408-4a4c-b789-68b60ae00e38" released by "delete_snapshot" :: held 2.988s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-3059575f-7f14-47b2-b465-8903ff1c827b" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-3059575f-7f14-47b2-b465-8903ff1c827b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-faa58f76-4516-4045-bc32-e815f3a24c54" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-faa58f76-4516-4045-bc32-e815f3a24c54" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Deleting offline snapshot faa58f76-4516-4045-bc32-e815f3a24c54 of volume 3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] snapshot_file for this snap is: volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5423a24-8ded-4030-b2ed-2efef15f0cdb]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:19 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 Apr 29 18:16:19 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Creating offline snapshot 0ce5746b-824a-4a9e-9410-a914066fd9fb of volume 607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4bd3da-cf99-47f9-ae21-3aebe5a8bb0d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:19 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd.53575f03-c41e-4cb3-a8d5-3cddbf305383" returned: 0 in 0.647s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-53575f03-c41e-4cb3-a8d5-3cddbf305383" released by "_delete_snapshot" :: held 3.057s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" released by "delete_snapshot" :: held 3.105s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:19 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c Apr 29 18:16:19 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Created reservations ['3facc6fa-c75c-46fc-a83d-7d0edc810562', 'ef5845c1-fa8b-4462-bd9c-efaf9999e520', 'f2d690a8-12e9-45ec-8092-938830475799', '179ab1c7-c50e-40c8-a31c-dba6bf49e13e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Delete snapshot completed successfully. Apr 29 18:16:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3eb2444b-87b2-4a68-b374-f8981577c41a tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-53575f03-c41e-4cb3-a8d5-3cddbf305383-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:20 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54" returned: 0 in 0.786s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3059575f-7f14-47b2-b465-8903ff1c827b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[69569dba-9038-4a4c-bc8d-d179f61243f3]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:20 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b Apr 29 18:16:20 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:20 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" returned: 0 in 0.720s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:20 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb 1G Apr 29 18:16:20 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:20 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:20 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 Apr 29 18:16:20 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" acquired by "delete_volume" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef91152-43dc-4f0f-b09c-9b7e693563a2]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:21 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd Apr 29 18:16:21 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:21 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb 1G" returned: 0 in 0.913s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:21 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb Apr 29 18:16:21 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:21 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54" returned: 0 in 0.793s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:21 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54 Apr 29 18:16:21 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:21 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" returned: 0 in 0.773s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:21 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd Apr 29 18:16:21 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:21 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb" returned: 0 in 0.715s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:21 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb is being set with open permissions: ugo+rw Apr 29 18:16:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:21 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb Apr 29 18:16:21 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:22 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b.faa58f76-4516-4045-bc32-e815f3a24c54" returned: 0 in 0.641s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-faa58f76-4516-4045-bc32-e815f3a24c54" released by "_delete_snapshot" :: held 3.086s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-3059575f-7f14-47b2-b465-8903ff1c827b" released by "delete_snapshot" :: held 3.119s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:22 devstack cinder-volume[84402]: WARNING cinder.quota [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1460598479 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1460598479, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:16:22 devstack cinder-volume[84402]: WARNING cinder.quota [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1460598479 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1460598479, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Created reservations ['7c4023ee-63a2-482d-bf77-105808b39c28', 'e23806ee-e36e-424a-a412-86119c8a034a', '71efec21-7d2b-4f06-b8c9-39dca943c1c6', 'b0e1a429-7f96-44d1-a8db-f70ca24e00bc'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:22 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" returned: 0 in 0.674s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-quobyte-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd" released by "delete_volume" :: held 1.519s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:22 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb" returned: 0 in 0.615s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] Created reservations ['88c2a9c7-2672-4f88-be25-b163e464fc9d', '61e1243a-7e76-4cb4-83f6-ea94a3d8ffb6', 'ca59ce1a-bfb1-41a3-ae02-7799a95fbe7e', 'dc11d7fd-4d89-4933-813e-c7b5c31ee5bc'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Created reservations ['2b0ebef9-fb38-4dac-8918-acb934088bed', '9c3c496a-d2a1-44bd-ac19-91beff789973', 'd416e95f-21c7-49e4-ad27-351594fbae85', 'a7a3d298-b6c6-4e3a-a64d-1987f0e4fb43'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:22 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info Apr 29 18:16:22 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3fcb1750-2e26-40b4-8ec4-736ca5472282 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 65a0fed4-8ddc-4ac4-b3c2-41ca989b0c22: deleted successfully Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:22 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:22 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:23 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info" returned: 0 in 0.594s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:23 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info is being set with open permissions: ugo+rw Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:23 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info Apr 29 18:16:23 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:23 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.597s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Deleted volume successfully. Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-bb710100-a3ae-4fed-ac60-f9913edb9f7b tempest-VolumesSnapshotListTestJSON-629811554 None] Lock "cinder-c4b9d9cf-a0b4-465d-9704-86b7013b0ccd-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:23 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.info" returned: 0 in 0.680s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.363s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7d390709-539f-4f40-821b-1020289334c3 tempest-CinderUnicodeTest-484019977 None] Create snapshot completed successfully Apr 29 18:16:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-3059575f-7f14-47b2-b465-8903ff1c827b" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-3059575f-7f14-47b2-b465-8903ff1c827b" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b3ab16-5c45-4e79-aa12-fa4ca416d603]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:24 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b Apr 29 18:16:24 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:24 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-0ce5746b-824a-4a9e-9410-a914066fd9fb-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b" returned: 0 in 0.806s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-0ce5746b-824a-4a9e-9410-a914066fd9fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-quobyte-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:24 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b Apr 29 18:16:24 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-quobyte-0ce5746b-824a-4a9e-9410-a914066fd9fb" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-0ce5746b-824a-4a9e-9410-a914066fd9fb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Deleting offline snapshot 0ce5746b-824a-4a9e-9410-a914066fd9fb of volume 607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] snapshot_file for this snap is: volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf65eb3-129f-44cd-bc50-a7cba5f5367d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:25 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb Apr 29 18:16:25 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:25 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-3059575f-7f14-47b2-b465-8903ff1c827b" returned: 0 in 0.655s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-3059575f-7f14-47b2-b465-8903ff1c827b" released by "delete_volume" :: held 1.534s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-46c2aaf6-1408-4a4c-b789-68b60ae00e38" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-46c2aaf6-1408-4a4c-b789-68b60ae00e38" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca2e4d-3767-4686-a784-39612fc937b0]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:25 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb" returned: 0 in 0.743s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:25 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 Apr 29 18:16:25 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1199e87-e940-4374-999c-6a01e5ea3a33]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:25 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c Apr 29 18:16:25 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:26 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38" returned: 0 in 0.764s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:26 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38 Apr 29 18:16:26 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:26 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" returned: 0 in 0.781s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:26 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb Apr 29 18:16:26 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (6a12b835-1d69-4596-b8d5-18e285544f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c3fe1e-5dfc-4104-acb5-9f0a617bc3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c3fe1e-5dfc-4104-acb5-9f0a617bc3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030314236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4211243-f1c8-4f6a-88a6-ad28e4d1a490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:26Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c446e5-0f43-4fcb-bfcc-0d83fd1cea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c446e5-0f43-4fcb-bfcc-0d83fd1cea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febcffda-4a18-4f4f-b4c1-4dddd58ae464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febcffda-4a18-4f4f-b4c1-4dddd58ae464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4211243-f1c8-4f6a-88a6-ad28e4d1a490', 'volume_name': 'volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3634b50-9534-4ae0-b19a-6d94eaf8e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3634b50-9534-4ae0-b19a-6d94eaf8e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e37f584-e9e5-4319-8baf-d18adb306a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:26 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Volume c4211243-f1c8-4f6a-88a6-ad28e4d1a490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490', 'volume_size': 1} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030314236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4211243-f1c8-4f6a-88a6-ad28e4d1a490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:26Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Creating volume c4211243-f1c8-4f6a-88a6-ad28e4d1a490 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:26 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:26 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 1073741824 Apr 29 18:16:26 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (390f6e54-de6b-4eda-b169-23f5e52dc00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca3a521-db47-4fc9-bb6f-734005e6882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca3a521-db47-4fc9-bb6f-734005e6882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-442893379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272902ac-a20d-4358-9ee6-04c668bdade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:27Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bfca8d-b85e-4b35-8d57-7b9baefa3497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bfca8d-b85e-4b35-8d57-7b9baefa3497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a97aea-21d1-40c8-9bc5-96d44559e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a97aea-21d1-40c8-9bc5-96d44559e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272902ac-a20d-4358-9ee6-04c668bdade6', 'volume_name': 'volume-272902ac-a20d-4358-9ee6-04c668bdade6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1ee77-97ba-4a5c-8e27-ccfb7ac35f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1ee77-97ba-4a5c-8e27-ccfb7ac35f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b84856-954d-48ab-8e6b-fe6ad7b9dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Volume 272902ac-a20d-4358-9ee6-04c668bdade6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272902ac-a20d-4358-9ee6-04c668bdade6', 'volume_size': 1} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:27 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-46c2aaf6-1408-4a4c-b789-68b60ae00e38" returned: 0 in 0.866s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-46c2aaf6-1408-4a4c-b789-68b60ae00e38" released by "delete_volume" :: held 1.718s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Created reservations ['2537a5a7-861e-43e7-b27f-addbb485755e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:27 devstack cinder-volume[84402]: WARNING cinder.quota [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1460598479 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1460598479, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Created reservations ['51cb720f-8d1c-4174-a8da-cba4aa9494c0', '18e82008-c9cf-4a4f-9b8b-f88b7647a839', '46ee4086-2797-444c-ad2d-e6d4b3cc0f81', 'cfedeef9-e0bf-4dae-9d3d-45de4f8f8247'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:27 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb" returned: 0 in 0.977s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:27 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb Apr 29 18:16:27 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (9eeb853b-0471-4b9d-acb1-2cae9f439a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920f854-8257-440e-aa68-f140fdec98d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920f854-8257-440e-aa68-f140fdec98d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809510184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3f0f06-b50d-43e7-a04c-be622a3445df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:27Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9b1f0d-2582-4e00-8b78-d28589a1552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9b1f0d-2582-4e00-8b78-d28589a1552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bf3fb0-b93f-47fc-a411-5809cc694a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bf3fb0-b93f-47fc-a411-5809cc694a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3f0f06-b50d-43e7-a04c-be622a3445df', 'volume_name': 'volume-0a3f0f06-b50d-43e7-a04c-be622a3445df', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7b578e-6697-4917-b794-5a034ebbdc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7b578e-6697-4917-b794-5a034ebbdc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792d404d-9937-496b-ace1-236d431caea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:27 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Volume 0a3f0f06-b50d-43e7-a04c-be622a3445df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3f0f06-b50d-43e7-a04c-be622a3445df', 'volume_size': 1} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Created reservations ['bb3b66ac-863d-4aab-aec3-dfb3d0527471', 'a40bfc82-1d00-476b-96f5-94c2d7b91321', 'f2f3e9e8-da83-4585-8b69-c8e84b1f407f', 'b4d89800-998c-4677-bb4a-a04756bb5062'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:27 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 1073741824" returned: 0 in 1.099s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:27 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 Apr 29 18:16:27 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:27 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:27 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (2da2045d-c68e-4833-9ecf-d8db7f00ef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f4ffe1-e933-401b-9e7f-68214c3aa69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f4ffe1-e933-401b-9e7f-68214c3aa69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606104598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacf2415-085b-4eba-986e-28be057f86f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:28Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce87b535-1ec0-4f5d-8df1-245d90a23de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce87b535-1ec0-4f5d-8df1-245d90a23de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56029f50-6143-4188-aeb9-46d4ad9ccb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56029f50-6143-4188-aeb9-46d4ad9ccb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacf2415-085b-4eba-986e-28be057f86f0', 'volume_name': 'volume-eacf2415-085b-4eba-986e-28be057f86f0', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5232be14-aebc-4809-8ed7-230fa756c6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5232be14-aebc-4809-8ed7-230fa756c6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4beb84ef-9945-44db-b1d8-636b757ee2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Volume eacf2415-085b-4eba-986e-28be057f86f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacf2415-085b-4eba-986e-28be057f86f0', 'volume_size': 1} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:28 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c.0ce5746b-824a-4a9e-9410-a914066fd9fb" returned: 0 in 0.876s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-0ce5746b-824a-4a9e-9410-a914066fd9fb" released by "_delete_snapshot" :: held 3.530s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" released by "delete_snapshot" :: held 3.567s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Created reservations ['d3e74793-0d5d-4fb1-b46e-6f1ce75e3553', '9d2f5688-aee7-4536-bd34-4783585246c3', '6d0926b3-0421-42c0-9d24-d10c8d194efa', '75257e9f-8749-463c-9132-9fb7c6f3e112'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (303b04aa-9d0b-4ede-afdd-042620b35608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1957fc-bc49-4c4d-b09e-880994ffe719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1957fc-bc49-4c4d-b09e-880994ffe719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419253925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a01126-1a23-456d-b563-57d5394cdbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:29Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e342b0-4164-4476-a6d6-9be7ab95aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e342b0-4164-4476-a6d6-9be7ab95aa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7993748-87ad-46b5-92a6-8d96fddf9de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7993748-87ad-46b5-92a6-8d96fddf9de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a01126-1a23-456d-b563-57d5394cdbcd', 'volume_name': 'volume-f9a01126-1a23-456d-b563-57d5394cdbcd', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b5e11c-8cf2-47f5-9b37-b32f52c4a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b5e11c-8cf2-47f5-9b37-b32f52c4a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f161401a-10ab-4743-b78b-bcefb5287256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Volume f9a01126-1a23-456d-b563-57d5394cdbcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a01126-1a23-456d-b563-57d5394cdbcd', 'volume_size': 1} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490" returned: 0 in 0.912s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.847s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.722s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-442893379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272902ac-a20d-4358-9ee6-04c668bdade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:27Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Creating volume 272902ac-a20d-4358-9ee6-04c668bdade6 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Delete snapshot completed successfully. Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-53606030-e1d1-4215-87d9-f025cdda18fb tempest-GroupSnapshotsTest-550771466 None] Delete group completed successfully. Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e37f584-e9e5-4319-8baf-d18adb306a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 1073741824 Apr 29 18:16:28 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6852253e-0585-4944-9959-b06df9b25ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-891b6eb3-159f-4515-9d5d-e976e7fa30a0 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-0ce5746b-824a-4a9e-9410-a914066fd9fb-delete_snapshot" released by "delete_snapshot" :: held 3.995s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Volume volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 (c4211243-f1c8-4f6a-88a6-ad28e4d1a490): created successfully Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6852253e-0585-4944-9959-b06df9b25ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (6a12b835-1d69-4596-b8d5-18e285544f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:28 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c19c0ae8-a675-4116-b957-908f47696c52 tempest-CreateVolumesFromImageTest-709197989 None] Created volume successfully. Apr 29 18:16:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-24cd7e1c-aba4-4d58-b8d5-b9ae64656ef2 tempest-GroupSnapshotsTest-550771466 None] Group tempest-GroupSnapshotsTest-Group-904318774: creating Apr 29 18:16:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-24cd7e1c-aba4-4d58-b8d5-b9ae64656ef2 tempest-GroupSnapshotsTest-550771466 None] Group tempest-GroupSnapshotsTest-Group-904318774: created successfully Apr 29 18:16:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-24cd7e1c-aba4-4d58-b8d5-b9ae64656ef2 tempest-GroupSnapshotsTest-550771466 None] Create group completed successfully. Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-quobyte-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a09be97-326e-4f44-9c5f-4e32c4f7fa96]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:29 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c Apr 29 18:16:29 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:29 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 1073741824" returned: 0 in 0.889s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:29 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 Apr 29 18:16:29 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:29 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" returned: 0 in 0.764s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:29 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c Apr 29 18:16:30 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:30 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6" returned: 0 in 0.620s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.708s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809510184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3f0f06-b50d-43e7-a04c-be622a3445df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:27Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Creating volume 0a3f0f06-b50d-43e7-a04c-be622a3445df {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:30 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b84856-954d-48ab-8e6b-fe6ad7b9dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272902ac-a20d-4358-9ee6-04c668bdade6', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:30 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df 1073741824 Apr 29 18:16:30 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ac81e1-25fa-4c96-aca4-406e735f38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Volume volume-272902ac-a20d-4358-9ee6-04c668bdade6 (272902ac-a20d-4358-9ee6-04c668bdade6): created successfully Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ac81e1-25fa-4c96-aca4-406e735f38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (390f6e54-de6b-4eda-b169-23f5e52dc00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:30 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d8de9c5b-5945-483a-a0fa-4b7f3ace80f6 tempest-CreateVolumesFromImageTest-709197989 None] Created volume successfully. Apr 29 18:16:30 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" returned: 0 in 0.663s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (6e1d88e3-4ea1-4d22-b58f-2a4da2996526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891e82b9-47c1-4144-9990-2c6f325c86da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c" released by "delete_volume" :: held 1.526s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891e82b9-47c1-4144-9990-2c6f325c86da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1983110059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78ec8a3c-60e7-4782-ab5b-10122156bf8e,host='devstack@QuobyteHD#QuobyteHD',id=81834c13-de35-4456-b119-39c71ac53cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:31Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ef19de-bd21-41a2-bd80-324410b220ac),volume_type_id=70ef19de-bd21-41a2-bd80-324410b220ac)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0762aa5f-e844-4e71-aaa5-29854a403e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0762aa5f-e844-4e71-aaa5-29854a403e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f986ded9-8e8e-450a-829a-2fdc3fc45e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f986ded9-8e8e-450a-829a-2fdc3fc45e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81834c13-de35-4456-b119-39c71ac53cb3', 'volume_name': 'volume-81834c13-de35-4456-b119-39c71ac53cb3', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59f19a4-fdd8-4286-94d7-90a4db3a5cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59f19a4-fdd8-4286-94d7-90a4db3a5cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec44968-b867-4f49-9764-a237183a9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Volume 81834c13-de35-4456-b119-39c71ac53cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81834c13-de35-4456-b119-39c71ac53cb3', 'volume_size': 1} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Created reservations ['028331e5-b507-4e44-ac21-5e2068e32640', '88f9bd1a-8a68-49c4-a17a-f679ed95c3ea', '048cb4d7-5c9f-422e-b755-5c7625e8f1e7', 'fd6f1b7b-ec00-4673-b28f-f88e9276b52e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:30 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:30 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:31 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df 1073741824" returned: 0 in 0.832s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:31 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df Apr 29 18:16:31 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-c40cc180-fa48-4d94-95ef-05555f4d013a-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Lock "cinder-c40cc180-fa48-4d94-95ef-05555f4d013a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Acquiring lock "cinder-quobyte-c40cc180-fa48-4d94-95ef-05555f4d013a" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-c40cc180-fa48-4d94-95ef-05555f4d013a" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f545695e-ecb7-49be-b6d5-bd5218c2eedc]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:31 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.638s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:31 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Deleted volume successfully. Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80ad74f2-69fb-4305-abfc-0c706ecf6619 tempest-CinderUnicodeTest-484019977 None] Lock "cinder-607f1ad4-3ae8-41a7-9ce9-770bd8ee214c-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:31 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a Apr 29 18:16:31 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:31 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df" returned: 0 in 0.666s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606104598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacf2415-085b-4eba-986e-28be057f86f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:28Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Creating volume eacf2415-085b-4eba-986e-28be057f86f0 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:31 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:31 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 1073741824 Apr 29 18:16:31 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792d404d-9937-496b-ace1-236d431caea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3f0f06-b50d-43e7-a04c-be622a3445df', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:31 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91937b79-91cd-49aa-abea-ad91f31ff174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:32 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Volume volume-0a3f0f06-b50d-43e7-a04c-be622a3445df (0a3f0f06-b50d-43e7-a04c-be622a3445df): created successfully Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91937b79-91cd-49aa-abea-ad91f31ff174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (9eeb853b-0471-4b9d-acb1-2cae9f439a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fb914fe3-64eb-4e90-ab8a-de50705f5ea1 tempest-CreateVolumesFromImageTest-709197989 None] Created volume successfully. Apr 29 18:16:32 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a" returned: 0 in 0.711s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:32 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a Apr 29 18:16:32 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:32 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c40cc180-fa48-4d94-95ef-05555f4d013a" returned: 0 in 0.574s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:32 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 1073741824" returned: 0 in 0.805s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Lock "cinder-quobyte-c40cc180-fa48-4d94-95ef-05555f4d013a" released by "delete_volume" :: held 1.336s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:32 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 Apr 29 18:16:32 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Created reservations ['150d3bcf-4ae6-44a2-a362-0ae6d8a32e0d', 'c8422231-7da0-4401-b710-113329fa4313', '073daa87-c11b-4f96-b23c-ab128c458265', '6db50702-7174-4b9f-926c-5b52029e5f8f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:32 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:32 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:33 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0" returned: 0 in 0.576s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.581s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419253925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a01126-1a23-456d-b563-57d5394cdbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5190f1a8746ea9a9dedbe0e677d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:29Z,use_quota=True,user_id='948fe42d252b49e18ece97456f99203f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Creating volume f9a01126-1a23-456d-b563-57d5394cdbcd {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:33 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4beb84ef-9945-44db-b1d8-636b757ee2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacf2415-085b-4eba-986e-28be057f86f0', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:33 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd 1073741824 Apr 29 18:16:33 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ddaed2-c009-4336-ba18-eb5b0e313393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:33 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Volume volume-eacf2415-085b-4eba-986e-28be057f86f0 (eacf2415-085b-4eba-986e-28be057f86f0): created successfully Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ddaed2-c009-4336-ba18-eb5b0e313393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (2da2045d-c68e-4833-9ecf-d8db7f00ef18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5167eb0f-52c4-4b1e-b3a7-8d3a99a606a4 tempest-CreateVolumesFromImageTest-709197989 None] Created volume successfully. Apr 29 18:16:33 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.599s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Deleted volume successfully. Apr 29 18:16:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f2abe283-4b9e-4bb1-8fe9-32799ffbabdd tempest-CinderUnicodeTest-484019977 None] Lock "cinder-c40cc180-fa48-4d94-95ef-05555f4d013a-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:34 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd 1073741824" returned: 0 in 0.813s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:34 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd Apr 29 18:16:34 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:34 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd" returned: 0 in 0.651s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.151s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78ec8a3c-60e7-4782-ab5b-10122156bf8e,created_at=2026-04-29T16:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1983110059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78ec8a3c-60e7-4782-ab5b-10122156bf8e,host='devstack@QuobyteHD#QuobyteHD',id=81834c13-de35-4456-b119-39c71ac53cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda8d5a7d6fe490ababb06628565352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:31Z,use_quota=True,user_id='80d5cce7156a49b48fb15866ea1876a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ef19de-bd21-41a2-bd80-324410b220ac),volume_type_id=70ef19de-bd21-41a2-bd80-324410b220ac)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Creating volume 81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:34 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f161401a-10ab-4743-b78b-bcefb5287256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a01126-1a23-456d-b563-57d5394cdbcd', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb665265-638a-4ea9-9f70-f9d1977ef681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:34 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 1073741824 Apr 29 18:16:34 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:34 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Volume volume-f9a01126-1a23-456d-b563-57d5394cdbcd (f9a01126-1a23-456d-b563-57d5394cdbcd): created successfully Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb665265-638a-4ea9-9f70-f9d1977ef681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Flow 'volume_create_manager' (303b04aa-9d0b-4ede-afdd-042620b35608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:34 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0dff3819-ac26-4684-baa6-664f136c9f90 tempest-CreateVolumesFromImageTest-709197989 None] Created volume successfully. Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-f9a01126-1a23-456d-b563-57d5394cdbcd-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-f9a01126-1a23-456d-b563-57d5394cdbcd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-quobyte-f9a01126-1a23-456d-b563-57d5394cdbcd" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-f9a01126-1a23-456d-b563-57d5394cdbcd" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fba115-3f50-43c3-b51e-f31a2ef674f1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:35 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd Apr 29 18:16:35 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:35 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 1073741824" returned: 0 in 0.829s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:35 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 Apr 29 18:16:35 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:35 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:35 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:36 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd" returned: 0 in 0.748s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:36 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd Apr 29 18:16:36 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:36 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3" returned: 0 in 0.634s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec44968-b867-4f49-9764-a237183a9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81834c13-de35-4456-b119-39c71ac53cb3', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2010c24f-1f79-4ecc-a6e3-7d7c4484cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:36 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Volume volume-81834c13-de35-4456-b119-39c71ac53cb3 (81834c13-de35-4456-b119-39c71ac53cb3): created successfully Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2010c24f-1f79-4ecc-a6e3-7d7c4484cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Flow 'volume_create_manager' (6e1d88e3-4ea1-4d22-b58f-2a4da2996526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:36 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:36 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f1807f65-7d05-46a3-9549-b20f1a206b19 tempest-GroupSnapshotsTest-550771466 None] Created volume successfully. Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:36 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-f9a01126-1a23-456d-b563-57d5394cdbcd" returned: 0 in 0.592s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-f9a01126-1a23-456d-b563-57d5394cdbcd" released by "delete_volume" :: held 1.384s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Created reservations ['9f02d2cc-e14a-4f7a-93c0-d51279ad5ce8', 'de3d306c-1fa6-4972-bd3c-4cacc119e737', '83d9d794-a034-431c-9a69-2d6df3c6d82f', '4365b1bd-c0f0-4b09-be49-9534371765a4'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:36 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:36 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] GroupSnapshot 4dcbb688-a0c1-4e61-a1e8-cd083bfc4e15: creating. Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Group snapshot 4dcbb688-a0c1-4e61-a1e8-cd083bfc4e15: creating. {{(pid=84402) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Creating offline snapshot ec3f8014-a4b1-4089-b815-feb4755269d7 of volume 81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f575b867-fb03-4bba-893f-32cadaa20a0c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:37 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.605s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Deleted volume successfully. Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f063035b-162c-4564-9742-d08e5c0aca46 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-f9a01126-1a23-456d-b563-57d5394cdbcd-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-eacf2415-085b-4eba-986e-28be057f86f0-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-eacf2415-085b-4eba-986e-28be057f86f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:37 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 Apr 29 18:16:37 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-quobyte-eacf2415-085b-4eba-986e-28be057f86f0" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-eacf2415-085b-4eba-986e-28be057f86f0" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8de583b-4512-4b1e-a744-ea00b6355aa9]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:37 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 Apr 29 18:16:37 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:38 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3" returned: 0 in 0.719s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:38 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 1G Apr 29 18:16:38 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:38 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0" returned: 0 in 0.716s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:38 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0 Apr 29 18:16:38 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:38 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-eacf2415-085b-4eba-986e-28be057f86f0" returned: 0 in 0.574s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:38 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 1G" returned: 0 in 0.762s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81834c13-de35-4456-b119-39c71ac53cb3 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-eacf2415-085b-4eba-986e-28be057f86f0" released by "delete_volume" :: held 1.342s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:38 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81834c13-de35-4456-b119-39c71ac53cb3 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 Apr 29 18:16:38 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:38 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Created reservations ['720e0444-0ca6-4757-8b36-dbabd9479fce', 'bef2b5e9-d763-493f-ba39-814204c70734', '0348dc33-aef0-4cf4-beed-c651351635b2', 'fb4c60eb-fadf-401c-a9ca-4fe87cf30461'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:39 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:39 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:39 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81834c13-de35-4456-b119-39c71ac53cb3 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7" returned: 0 in 0.644s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:39 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:39 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 Apr 29 18:16:39 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:39 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.596s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:39 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Deleted volume successfully. Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c34d1521-a4ce-4890-8e17-585fca6e07b2 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-eacf2415-085b-4eba-986e-28be057f86f0-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-0a3f0f06-b50d-43e7-a04c-be622a3445df-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-0a3f0f06-b50d-43e7-a04c-be622a3445df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-quobyte-0a3f0f06-b50d-43e7-a04c-be622a3445df" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-0a3f0f06-b50d-43e7-a04c-be622a3445df" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac9d073-ba15-409c-9df3-35665feef04d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:39 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df Apr 29 18:16:39 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:40 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7" returned: 0 in 0.596s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:40 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info Apr 29 18:16:40 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:40 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df" returned: 0 in 0.698s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:40 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df Apr 29 18:16:40 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:40 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info" returned: 0 in 0.586s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:40 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:16:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:40 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info Apr 29 18:16:40 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:41 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a3f0f06-b50d-43e7-a04c-be622a3445df" returned: 0 in 0.616s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-0a3f0f06-b50d-43e7-a04c-be622a3445df" released by "delete_volume" :: held 1.351s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=166,cinder:UPDATE=217,cinder:DELETE=16,cinder:INSERT=46 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Created reservations ['e4ff441a-0c3e-4466-8fd2-14167feb2c50', '2feab7b2-2c7f-4735-a648-fb47ed748d87', '47fe7c6f-91ec-4008-9e2c-cf2b90a49dcd', '86fba689-9b6b-4420-adf6-c9b18fdd76f8'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:41 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.info" returned: 0 in 0.589s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:41 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:41 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b129bc6a-5685-42f0-92ce-e5308fa5e205 tempest-GroupSnapshotsTest-550771466 None] group_snapshot 4dcbb688-a0c1-4e61-a1e8-cd083bfc4e15: created successfully Apr 29 18:16:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] group_snapshot 4dcbb688-a0c1-4e61-a1e8-cd083bfc4e15: deleting Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] group_snapshot 4dcbb688-a0c1-4e61-a1e8-cd083bfc4e15: deleting {{(pid=84402) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-81834c13-de35-4456-b119-39c71ac53cb3" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-81834c13-de35-4456-b119-39c71ac53cb3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-ec3f8014-a4b1-4089-b815-feb4755269d7" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-ec3f8014-a4b1-4089-b815-feb4755269d7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Deleting offline snapshot ec3f8014-a4b1-4089-b815-feb4755269d7 of volume 81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] snapshot_file for this snap is: volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f793596-70df-4c0c-9fbb-f46a5ae382cf]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:41 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.629s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:41 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 Apr 29 18:16:41 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-272902ac-a20d-4358-9ee6-04c668bdade6-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Deleted volume successfully. Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-272902ac-a20d-4358-9ee6-04c668bdade6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7305235f-032d-4602-88b0-f40c0833ea7b tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-0a3f0f06-b50d-43e7-a04c-be622a3445df-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-quobyte-272902ac-a20d-4358-9ee6-04c668bdade6" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-272902ac-a20d-4358-9ee6-04c668bdade6" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0387ed-97e2-464a-943a-c412d26ee657]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:42 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 Apr 29 18:16:42 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:42 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7" returned: 0 in 0.736s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81834c13-de35-4456-b119-39c71ac53cb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ac59f-0da5-4155-ada4-9c7c98d74580]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:42 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 Apr 29 18:16:42 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:42 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6" returned: 0 in 0.710s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:42 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6 Apr 29 18:16:42 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:43 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3" returned: 0 in 0.739s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:43 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-272902ac-a20d-4358-9ee6-04c668bdade6" returned: 0 in 0.590s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:43 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 Apr 29 18:16:43 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-272902ac-a20d-4358-9ee6-04c668bdade6" released by "delete_volume" :: held 1.341s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Created reservations ['fd47bd5a-ee75-4730-9f2f-accef40e8e1b', 'eb984650-948e-4e04-ba60-6438fa14d7b6', 'f9e46803-a318-42ad-8a7f-ebb4fa2aa8b9', 'e416860b-87d5-4736-b82e-0e79c3b1eb70'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:43 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:43 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:44 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7" returned: 0 in 0.653s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:44 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7 Apr 29 18:16:44 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:44 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.622s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Deleted volume successfully. Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4ac42153-daab-4b5f-bf21-2e8b768b75b9 tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-272902ac-a20d-4358-9ee6-04c668bdade6-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-c4211243-f1c8-4f6a-88a6-ad28e4d1a490-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-c4211243-f1c8-4f6a-88a6-ad28e4d1a490-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "cinder-quobyte-c4211243-f1c8-4f6a-88a6-ad28e4d1a490" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-c4211243-f1c8-4f6a-88a6-ad28e4d1a490" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[907f25e0-c078-468f-b305-a8653e0928b6]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:44 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 Apr 29 18:16:44 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:44 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3.ec3f8014-a4b1-4089-b815-feb4755269d7" returned: 0 in 0.580s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-ec3f8014-a4b1-4089-b815-feb4755269d7" released by "_delete_snapshot" :: held 2.834s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-81834c13-de35-4456-b119-39c71ac53cb3" released by "delete_snapshot" :: held 2.855s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:44 devstack cinder-volume[84402]: WARNING cinder.quota [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-309723731 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-309723731, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:16:44 devstack cinder-volume[84402]: WARNING cinder.quota [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-309723731 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-309723731, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:16:44 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] Created reservations ['27ee56ae-e86c-4694-a1b3-162c05daecf0', '9838dc1f-f5d4-4b68-9687-87db2a722ba3', '19c4b305-19aa-4f8c-af30-54d4187296fe', '514301f1-0209-457f-9fdc-66c22111979a'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-39e75f16-b887-4168-8153-34a651ab9b5c tempest-GroupSnapshotsTest-550771466 None] group_snapshot 4dcbb688-a0c1-4e61-a1e8-cd083bfc4e15: deleted successfully Apr 29 18:16:45 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490" returned: 0 in 0.702s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:45 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490 Apr 29 18:16:45 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "cinder-quobyte-81834c13-de35-4456-b119-39c71ac53cb3" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-81834c13-de35-4456-b119-39c71ac53cb3" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5837952-cf91-4870-b4c2-eb133c36c8ba]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:45 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 Apr 29 18:16:45 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:45 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-c4211243-f1c8-4f6a-88a6-ad28e4d1a490" returned: 0 in 0.631s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-quobyte-c4211243-f1c8-4f6a-88a6-ad28e4d1a490" released by "delete_volume" :: held 1.376s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Created reservations ['a84f2c18-daa7-4966-ad82-abdaaf52ce71', 'ddaa05ae-c9f3-40a6-be28-6f7aca291fc6', '640648d7-4bc4-49ce-bde2-46c3aa77da02', 'fc0726fe-29e6-4e81-8d6f-94f976636a9c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:45 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:45 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:46 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3" returned: 0 in 0.712s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:46 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3 Apr 29 18:16:46 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:46 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.612s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Deleted volume successfully. Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8f104895-578e-4ea5-9943-e00fa43072ee tempest-CreateVolumesFromImageTest-709197989 None] Lock "cinder-c4211243-f1c8-4f6a-88a6-ad28e4d1a490-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:46 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-81834c13-de35-4456-b119-39c71ac53cb3" returned: 0 in 0.606s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Lock "cinder-quobyte-81834c13-de35-4456-b119-39c71ac53cb3" released by "delete_volume" :: held 1.409s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Created reservations ['f09a66d9-6d63-4d73-96b3-379434e41151'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:46 devstack cinder-volume[84402]: WARNING cinder.quota [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-309723731 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-309723731, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Created reservations ['5a4b4d8a-d822-481f-9025-fb55f41e2a08', '8029c86a-f50a-415e-a69b-dd4dc099d517', 'b8aed6b4-e945-4714-a9f3-c8ecea2ce1eb', '20470dbe-b794-4696-8464-b72731244cb3'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:46 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:16:46 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:47 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.656s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:47 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:16:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0ae2c856-8e8c-4d95-9334-65bf39d8f8ea tempest-GroupSnapshotsTest-550771466 None] Delete group completed successfully. Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (f36bfd18-312a-4561-824f-1897f09d3f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d3bf5-3e3c-4e48-9727-2702678e8131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d3bf5-3e3c-4e48-9727-2702678e8131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027370640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:50Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09de2e10-18f5-44dc-8da3-0e8bf9c9daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09de2e10-18f5-44dc-8da3-0e8bf9c9daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c536611b-1613-4600-94d9-31660f92d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c536611b-1613-4600-94d9-31660f92d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9', 'volume_name': 'volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e14207b-4eed-4cc6-afea-8be379ab1e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e14207b-4eed-4cc6-afea-8be379ab1e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90196475-5a5c-4e4b-a147-54c6c5d61a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:49 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9', 'volume_size': 1} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027370640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:50Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating volume bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:49 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:49 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 1073741824 Apr 29 18:16:49 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:50 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 1073741824" returned: 0 in 0.822s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:50 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 Apr 29 18:16:50 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:51 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" returned: 0 in 0.645s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90196475-5a5c-4e4b-a147-54c6c5d61a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b102eb3-0e42-44ae-8876-0ca74f947e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:51 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 (bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9): created successfully Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b102eb3-0e42-44ae-8876-0ca74f947e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (f36bfd18-312a-4561-824f-1897f09d3f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:51 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-df45c001-f203-46f7-a416-c9166caabc53 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created volume successfully. Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating offline snapshot 14e0794d-2b8b-4aca-abcb-1f44cf92d3af of volume bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[468999b0-5fc5-46bc-a309-6b861881022c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:16:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:52 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 Apr 29 18:16:52 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2dadfef7-e9eb-4474-b26f-5483cd96f6b3 tempest-GroupSnapshotsV319Test-367194243 None] Group tempest-GroupSnapshotsV319Test-Group-750731611: creating Apr 29 18:16:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2dadfef7-e9eb-4474-b26f-5483cd96f6b3 tempest-GroupSnapshotsV319Test-367194243 None] Group tempest-GroupSnapshotsV319Test-Group-750731611: created successfully Apr 29 18:16:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2dadfef7-e9eb-4474-b26f-5483cd96f6b3 tempest-GroupSnapshotsV319Test-367194243 None] Create group completed successfully. Apr 29 18:16:52 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" returned: 0 in 0.835s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:52 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af 1G Apr 29 18:16:52 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:53 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af 1G" returned: 0 in 0.725s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:53 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af Apr 29 18:16:53 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Flow 'volume_create_manager' (f232e5f2-eaa3-4bdd-b9ed-f77fd5815a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e3f316-9d8e-4bfd-a52a-d1281c064ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e3f316-9d8e-4bfd-a52a-d1281c064ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-190951713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f6a6c40-edf4-4c9e-a1f1-1551ce9a3354,host='devstack@QuobyteHD#QuobyteHD',id=66c506d3-3419-4bb7-8cb9-1516d877b98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b1c17410ed43a39db23ddd61038fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:54Z,use_quota=True,user_id='df10bd16018d46f8add570cf7040d6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5896544-bb80-429a-bbae-c36915e89033),volume_type_id=b5896544-bb80-429a-bbae-c36915e89033)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24ce8b-3d34-482b-b1cf-4c6667f7eed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:54 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24ce8b-3d34-482b-b1cf-4c6667f7eed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658382bf-81ae-4329-b793-7977e7578251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658382bf-81ae-4329-b793-7977e7578251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c506d3-3419-4bb7-8cb9-1516d877b98c', 'volume_name': 'volume-66c506d3-3419-4bb7-8cb9-1516d877b98c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f7bd66-d414-45ee-94de-6a13c4a5073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f7bd66-d414-45ee-94de-6a13c4a5073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a4dd67-d796-41d3-b46f-08272b123f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:54 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Volume 66c506d3-3419-4bb7-8cb9-1516d877b98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c506d3-3419-4bb7-8cb9-1516d877b98c', 'volume_size': 1} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:54 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af is being set with open permissions: ugo+rw Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:54 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af Apr 29 18:16:54 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:54 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af" returned: 0 in 0.606s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:54 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info Apr 29 18:16:54 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:55 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info" returned: 0 in 0.643s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:55 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info is being set with open permissions: ugo+rw Apr 29 18:16:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:55 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info Apr 29 18:16:55 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:56 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.info" returned: 0 in 0.612s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.270s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f6a6c40-edf4-4c9e-a1f1-1551ce9a3354,created_at=2026-04-29T16:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-190951713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f6a6c40-edf4-4c9e-a1f1-1551ce9a3354,host='devstack@QuobyteHD#QuobyteHD',id=66c506d3-3419-4bb7-8cb9-1516d877b98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b1c17410ed43a39db23ddd61038fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:54Z,use_quota=True,user_id='df10bd16018d46f8add570cf7040d6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5896544-bb80-429a-bbae-c36915e89033),volume_type_id=b5896544-bb80-429a-bbae-c36915e89033)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Creating volume 66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:56 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:56 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c 1073741824 Apr 29 18:16:56 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:56 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d0f2c6ba-273b-4853-aab4-790bd4a76f80 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Create snapshot completed successfully Apr 29 18:16:56 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c 1073741824" returned: 0 in 0.773s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:56 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c Apr 29 18:16:56 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (311949ff-91d3-452f-be09-c0c0e221a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac25f22c-0c81-4fd4-815d-ee57a7cde821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac25f22c-0c81-4fd4-815d-ee57a7cde821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557827706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820f63c8-2382-43f3-95e8-1502d18add6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:57Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06817e1d-8a95-4a30-92a5-e8abf8d385df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06817e1d-8a95-4a30-92a5-e8abf8d385df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7107c706-dc6b-4e8d-bf3d-9af186f15bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7107c706-dc6b-4e8d-bf3d-9af186f15bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820f63c8-2382-43f3-95e8-1502d18add6f', 'volume_name': 'volume-820f63c8-2382-43f3-95e8-1502d18add6f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1966c5-63fb-476f-87f6-ac8f85e8fa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1966c5-63fb-476f-87f6-ac8f85e8fa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dba1bb-e374-4278-961b-d9d8d95927b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume 820f63c8-2382-43f3-95e8-1502d18add6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820f63c8-2382-43f3-95e8-1502d18add6f', 'volume_size': 1} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:57 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c" returned: 0 in 0.637s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.027s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557827706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820f63c8-2382-43f3-95e8-1502d18add6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:57Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating volume 820f63c8-2382-43f3-95e8-1502d18add6f {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:57 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a4dd67-d796-41d3-b46f-08272b123f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c506d3-3419-4bb7-8cb9-1516d877b98c', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f 1073741824 Apr 29 18:16:57 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a611854b-d7ff-4485-82d7-f32dcb768856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Volume volume-66c506d3-3419-4bb7-8cb9-1516d877b98c (66c506d3-3419-4bb7-8cb9-1516d877b98c): created successfully Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a611854b-d7ff-4485-82d7-f32dcb768856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Flow 'volume_create_manager' (f232e5f2-eaa3-4bdd-b9ed-f77fd5815a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ed9062df-c0f1-4b69-98c8-f3ff1e869bff tempest-GroupSnapshotsV319Test-367194243 None] Created volume successfully. Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (68331270-97a6-40f8-84b9-ddcd402f0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f9af8c-67a4-4ace-b10f-95c1b11c7eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f9af8c-67a4-4ace-b10f-95c1b11c7eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474924844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf32e84-80b6-49ae-8668-cc4de543fcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:58Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f292ef50-db5f-4ee5-a856-01fbdf5f4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f292ef50-db5f-4ee5-a856-01fbdf5f4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bd142b-98bb-4fc4-8680-4d3b4a96849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bd142b-98bb-4fc4-8680-4d3b4a96849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf32e84-80b6-49ae-8668-cc4de543fcb5', 'volume_name': 'volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b723b9d5-3848-4002-8605-4d5183909072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b723b9d5-3848-4002-8605-4d5183909072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7246c978-6fc3-416c-968e-0258ba18daf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:57 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume 2cf32e84-80b6-49ae-8668-cc4de543fcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5', 'volume_size': 1} Apr 29 18:16:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (b91b4828-6597-454f-8839-166cde61f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f86b30-c637-4fa2-a27c-27c0c32d8776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f86b30-c637-4fa2-a27c-27c0c32d8776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1733720286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011051c9-0e3e-48a3-a26a-95b426f83309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:58Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c55d83-d2b2-4da0-b92c-06a3578899b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c55d83-d2b2-4da0-b92c-06a3578899b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca19a2b-4237-4861-8c79-7044eb96a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca19a2b-4237-4861-8c79-7044eb96a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011051c9-0e3e-48a3-a26a-95b426f83309', 'volume_name': 'volume-011051c9-0e3e-48a3-a26a-95b426f83309', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26585490-3cd4-4479-96a3-1d1a4b42a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26585490-3cd4-4479-96a3-1d1a4b42a384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cee6f5f-3699-4e99-a409-04acb98084a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume 011051c9-0e3e-48a3-a26a-95b426f83309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011051c9-0e3e-48a3-a26a-95b426f83309', 'volume_size': 1} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (56386174-e89d-4b98-9eb6-2668b97da279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909bb9b1-3d14-445d-845f-2e929ee9e165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909bb9b1-3d14-445d-845f-2e929ee9e165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482280246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:58Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a4f1c9-119d-454d-b75b-6577b694dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a4f1c9-119d-454d-b75b-6577b694dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438060e7-db35-47de-829e-193c7f2b624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438060e7-db35-47de-829e-193c7f2b624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17', 'volume_name': 'volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5178a3-e02c-4a08-a02e-e15b06b2be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5178a3-e02c-4a08-a02e-e15b06b2be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b529cec-f1c6-4bc7-9141-2b9703a44f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17', 'volume_size': 1} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f 1073741824" returned: 0 in 0.979s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:58 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f Apr 29 18:16:58 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:58 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] GroupSnapshot ddb36055-e518-43da-a386-08108787ae18: creating. Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Group snapshot ddb36055-e518-43da-a386-08108787ae18: creating. {{(pid=84402) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (ae0e849d-17a3-4f66-b50d-a5d74db512cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ef2ead-8ebd-4921-9c63-f65ad361132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ef2ead-8ebd-4921-9c63-f65ad361132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643092011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053ca1d9-8f30-41b9-89a5-cf7b240505b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:59Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c55910-76ed-421c-a271-2ccf7bbe7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c55910-76ed-421c-a271-2ccf7bbe7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7292d25-e3a5-42c0-822c-44ea9a000e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7292d25-e3a5-42c0-822c-44ea9a000e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053ca1d9-8f30-41b9-89a5-cf7b240505b7', 'volume_name': 'volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49f5573-e59c-46bf-bc72-60a4433e6750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49f5573-e59c-46bf-bc72-60a4433e6750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97edb5de-4e9f-485d-ba47-b58912c687cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume 053ca1d9-8f30-41b9-89a5-cf7b240505b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7', 'volume_size': 1} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:59 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f" returned: 0 in 0.672s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474924844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf32e84-80b6-49ae-8668-cc4de543fcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:58Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating volume 2cf32e84-80b6-49ae-8668-cc4de543fcb5 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:16:59 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dba1bb-e374-4278-961b-d9d8d95927b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820f63c8-2382-43f3-95e8-1502d18add6f', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:59 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 1073741824 Apr 29 18:16:59 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff03e8f6-1163-4560-84c1-2e2c58f04238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:16:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume volume-820f63c8-2382-43f3-95e8-1502d18add6f (820f63c8-2382-43f3-95e8-1502d18add6f): created successfully Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff03e8f6-1163-4560-84c1-2e2c58f04238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:16:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (311949ff-91d3-452f-be09-c0c0e221a07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:16:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d4489b7f-b347-49f7-9c8b-6a4b98673ae4 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created volume successfully. Apr 29 18:17:00 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 1073741824" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:00 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 Apr 29 18:17:00 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:00 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1733720286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011051c9-0e3e-48a3-a26a-95b426f83309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:58Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating volume 011051c9-0e3e-48a3-a26a-95b426f83309 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:17:00 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:00 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 1073741824 Apr 29 18:17:00 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7246c978-6fc3-416c-968e-0258ba18daf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7d6ff2-02c0-4092-a3b0-0cb14ad00f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:00 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 (2cf32e84-80b6-49ae-8668-cc4de543fcb5): created successfully Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7d6ff2-02c0-4092-a3b0-0cb14ad00f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (68331270-97a6-40f8-84b9-ddcd402f0834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:00 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f87c73bf-a1bf-4938-b604-a00702f7c5b8 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created volume successfully. Apr 29 18:17:01 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 1073741824" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:01 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 Apr 29 18:17:01 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:02 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309" returned: 0 in 0.583s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.539s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482280246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:58Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating volume cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:17:02 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:02 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 1073741824 Apr 29 18:17:02 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cee6f5f-3699-4e99-a409-04acb98084a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011051c9-0e3e-48a3-a26a-95b426f83309', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23c4a07-b427-438d-a97d-3ebcba1a5ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume volume-011051c9-0e3e-48a3-a26a-95b426f83309 (011051c9-0e3e-48a3-a26a-95b426f83309): created successfully Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23c4a07-b427-438d-a97d-3ebcba1a5ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (b91b4828-6597-454f-8839-166cde61f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c504c12c-4971-45b6-a08d-7581e410d9bf tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created volume successfully. Apr 29 18:17:02 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 1073741824" returned: 0 in 0.761s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:02 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 Apr 29 18:17:02 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:03 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17" returned: 0 in 0.611s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.664s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b529cec-f1c6-4bc7-9141-2b9703a44f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85356eb8-2e0e-4af9-ae46-4aeace584f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Creating offline snapshot bf9da5bf-90d1-4587-abc1-754610923039 of volume 66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:17:03 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 (cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17): created successfully Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85356eb8-2e0e-4af9-ae46-4aeace584f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (56386174-e89d-4b98-9eb6-2668b97da279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[da454e5b-dee8-4a54-ae35-d760aab87bb4]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:03 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e4989c90-c7a7-478a-813d-979b170e8fcd tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created volume successfully. Apr 29 18:17:03 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c Apr 29 18:17:03 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:04 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c" returned: 0 in 0.710s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:04 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 1G Apr 29 18:17:04 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:05 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 1G" returned: 0 in 0.732s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c506d3-3419-4bb7-8cb9-1516d877b98c -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:05 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c506d3-3419-4bb7-8cb9-1516d877b98c -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 Apr 29 18:17:05 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:05 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c506d3-3419-4bb7-8cb9-1516d877b98c -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039" returned: 0 in 0.611s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:05 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:17:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:05 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 Apr 29 18:17:05 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:06 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039" returned: 0 in 0.568s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:06 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info Apr 29 18:17:06 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:06 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info" returned: 0 in 0.574s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:06 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:17:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:06 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info Apr 29 18:17:06 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:07 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.info" returned: 0 in 0.601s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.907s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.448s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643092011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053ca1d9-8f30-41b9-89a5-cf7b240505b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca54068877c241f9b6327d375be31a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:16:59Z,use_quota=True,user_id='21913072608c4d5bbe54157dcfe6273b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Creating volume 053ca1d9-8f30-41b9-89a5-cf7b240505b7 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:17:07 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:17:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:07 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 1073741824 Apr 29 18:17:07 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:07 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c685a7d7-66d6-4c6d-a714-51d18f41e3ab tempest-GroupSnapshotsV319Test-367194243 None] group_snapshot ddb36055-e518-43da-a386-08108787ae18: created successfully Apr 29 18:17:08 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 1073741824" returned: 0 in 0.746s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:08 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 Apr 29 18:17:08 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:08 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] group_snapshot ddb36055-e518-43da-a386-08108787ae18: deleting Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] group_snapshot ddb36055-e518-43da-a386-08108787ae18: deleting {{(pid=84402) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "cinder-quobyte-66c506d3-3419-4bb7-8cb9-1516d877b98c" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Lock "cinder-quobyte-66c506d3-3419-4bb7-8cb9-1516d877b98c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "cinder-quobyte-bf9da5bf-90d1-4587-abc1-754610923039" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Lock "cinder-quobyte-bf9da5bf-90d1-4587-abc1-754610923039" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Deleting offline snapshot bf9da5bf-90d1-4587-abc1-754610923039 of volume 66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] snapshot_file for this snap is: volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c6398-57a0-4084-91c4-87bf9eb28cf3]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:08 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 Apr 29 18:17:08 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:08 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97edb5de-4e9f-485d-ba47-b58912c687cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bea1ae-9eff-4aaf-968c-65b902b52495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:08 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Volume volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 (053ca1d9-8f30-41b9-89a5-cf7b240505b7): created successfully Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bea1ae-9eff-4aaf-968c-65b902b52495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:08 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Flow 'volume_create_manager' (ae0e849d-17a3-4f66-b50d-a5d74db512cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:08 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f2ace54c-2a03-4344-a516-dc3f6b574350 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created volume successfully. Apr 29 18:17:09 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039" returned: 0 in 0.689s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66c506d3-3419-4bb7-8cb9-1516d877b98c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c3ac04-a0e9-4164-a8c0-011679dd8869]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:09 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c Apr 29 18:17:09 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-053ca1d9-8f30-41b9-89a5-cf7b240505b7-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-053ca1d9-8f30-41b9-89a5-cf7b240505b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-053ca1d9-8f30-41b9-89a5-cf7b240505b7" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-053ca1d9-8f30-41b9-89a5-cf7b240505b7" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7699bb1-898d-4fca-97db-5489a315da44]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:10 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 Apr 29 18:17:10 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:10 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:10 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 Apr 29 18:17:10 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:10 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7" returned: 0 in 0.773s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:10 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7 Apr 29 18:17:10 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:10 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039" returned: 0 in 0.748s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:11 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039 Apr 29 18:17:11 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:11 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-053ca1d9-8f30-41b9-89a5-cf7b240505b7" returned: 0 in 0.640s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-053ca1d9-8f30-41b9-89a5-cf7b240505b7" released by "delete_volume" :: held 1.458s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['e418260e-e23d-4d04-972b-d40954ee6d40', 'c7155db8-367a-401d-804a-60faf1b45528', 'ea4c0ec5-5daa-4f89-8db1-4f41170e07b0', 'f9089a25-da9f-44ce-827b-333275f8bb00'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:11 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:11 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:11 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c.bf9da5bf-90d1-4587-abc1-754610923039" returned: 0 in 0.609s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Lock "cinder-quobyte-bf9da5bf-90d1-4587-abc1-754610923039" released by "_delete_snapshot" :: held 2.957s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Lock "cinder-quobyte-66c506d3-3419-4bb7-8cb9-1516d877b98c" released by "delete_snapshot" :: held 2.993s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:11 devstack cinder-volume[84402]: WARNING cinder.quota [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1323428917 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1323428917, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:17:11 devstack cinder-volume[84402]: WARNING cinder.quota [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1323428917 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1323428917, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:17:11 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] Created reservations ['f2afb996-383b-4ade-b716-80486b5a7b8f', '7b249364-8d92-408e-a7e6-be7054c4f246', '52979c4c-449c-4748-a650-9318bad8b21f', 'fe60b18b-4e94-46bc-8926-a4c6f031ab00'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8b0e47f4-0118-4df1-9a11-3c8ad447957c tempest-GroupSnapshotsV319Test-367194243 None] group_snapshot ddb36055-e518-43da-a386-08108787ae18: deleted successfully Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "cinder-quobyte-66c506d3-3419-4bb7-8cb9-1516d877b98c" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Lock "cinder-quobyte-66c506d3-3419-4bb7-8cb9-1516d877b98c" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:12 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572e972-2b40-418d-a9f5-fc86a014319c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.734s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[33330928-a433-4636-a477-935be35e5713]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleted volume successfully. Apr 29 18:17:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d94cd2b-f2fe-4f8b-987e-df814a383b47 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-053ca1d9-8f30-41b9-89a5-cf7b240505b7-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:12 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 Apr 29 18:17:12 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:12 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c Apr 29 18:17:12 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:13 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c" returned: 0 in 0.715s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:13 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:13 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c Apr 29 18:17:13 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17" returned: 0 in 0.760s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:13 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17 Apr 29 18:17:13 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:13 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-66c506d3-3419-4bb7-8cb9-1516d877b98c" returned: 0 in 0.600s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Lock "cinder-quobyte-66c506d3-3419-4bb7-8cb9-1516d877b98c" released by "delete_volume" :: held 1.377s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Created reservations ['c82c0f01-bc7a-4673-9baa-aa3da8873202'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:13 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17" returned: 0 in 0.678s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17" released by "delete_volume" :: held 1.499s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:13 devstack cinder-volume[84402]: WARNING cinder.quota [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1323428917 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1323428917, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Created reservations ['7ae26d08-d4e6-451c-ab58-af1f015eefc0', 'e90a1eff-26dc-4a87-99d8-9928ee5d2ce2', '879cdec1-76b0-4507-94c8-8ffa4bc6ba31', '4aa82eff-45b0-40bb-93d7-1abd8edcad96'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['51e28bc7-d5a2-44e9-95eb-34f0597b1138', '9f25463b-3365-49ca-8520-5903569199d4', '2f60fcc5-e681-4c47-a4f6-44951609ff34', '68475a8e-203f-4c01-8511-ec8997a8631b'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=181,cinder:UPDATE=218,cinder:INSERT=56,cinder:DELETE=12 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:17:13 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:13 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:13 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:13 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-011051c9-0e3e-48a3-a26a-95b426f83309-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-011051c9-0e3e-48a3-a26a-95b426f83309-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-011051c9-0e3e-48a3-a26a-95b426f83309" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-011051c9-0e3e-48a3-a26a-95b426f83309" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3410db-7c5a-42be-b542-429b0d9f84ee]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:14 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:14 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:14 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleted volume successfully. Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.644s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:14 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-59e6f57b-9f5f-4510-b60f-9fad69fdbfb0 tempest-GroupSnapshotsV319Test-367194243 None] Delete group completed successfully. Apr 29 18:17:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b43e23c6-04e1-4914-8402-7a632778a9c7 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-cc2e28e0-fe8b-4faa-bd7f-e98e5bd4ed17-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:14 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 Apr 29 18:17:14 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:15 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309" returned: 0 in 0.809s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:15 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309 Apr 29 18:17:15 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:15 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-011051c9-0e3e-48a3-a26a-95b426f83309" returned: 0 in 0.623s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-011051c9-0e3e-48a3-a26a-95b426f83309" released by "delete_volume" :: held 1.486s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['cecd2acb-86e8-4742-b8c1-631fd22732b1', 'fdc85178-d7a7-4770-85bb-a4d218929a9a', '400d6259-1ca5-4b1c-ae1f-129b010117d5', '15033527-0a37-4871-bfad-1fc8233198a9'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:16 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:16 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-2cf32e84-80b6-49ae-8668-cc4de543fcb5-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-2cf32e84-80b6-49ae-8668-cc4de543fcb5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-2cf32e84-80b6-49ae-8668-cc4de543fcb5" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-2cf32e84-80b6-49ae-8668-cc4de543fcb5" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9f88e-aee0-4d15-94fb-62e1dd26bca1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:16 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.708s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleted volume successfully. Apr 29 18:17:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4c920253-3708-4b73-9426-cc6d14f61dee tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-011051c9-0e3e-48a3-a26a-95b426f83309-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:16 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 Apr 29 18:17:16 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:17 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5" returned: 0 in 0.804s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:17 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5 Apr 29 18:17:17 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:18 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2cf32e84-80b6-49ae-8668-cc4de543fcb5" returned: 0 in 0.620s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-2cf32e84-80b6-49ae-8668-cc4de543fcb5" released by "delete_volume" :: held 1.476s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['7991c933-954e-4787-a858-42fa9942d3e5', '36654dc7-7927-4a16-b51d-b071ff4e2d41', 'dd43c5df-ab02-4754-ac4c-b3629fcc553a', 'ef390928-acad-4802-a2ab-8c1828a3d27c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:18 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:18 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-820f63c8-2382-43f3-95e8-1502d18add6f-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-820f63c8-2382-43f3-95e8-1502d18add6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:18 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.624s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:18 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleted volume successfully. Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0b855010-9ad9-4243-81b2-ab1bbdb036c5 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-2cf32e84-80b6-49ae-8668-cc4de543fcb5-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-820f63c8-2382-43f3-95e8-1502d18add6f" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-820f63c8-2382-43f3-95e8-1502d18add6f" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:19 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9324f321-2f10-46f1-98be-ad82d7a7006b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:19 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f Apr 29 18:17:19 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-00f813c0-5269-451c-afea-4f63b737f255 tempest-GroupsV320Test-419244652 None] Group tempest-GroupsV320Test-Group-1706126726: creating Apr 29 18:17:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-00f813c0-5269-451c-afea-4f63b737f255 tempest-GroupsV320Test-419244652 None] Group tempest-GroupsV320Test-Group-1706126726: created successfully Apr 29 18:17:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-00f813c0-5269-451c-afea-4f63b737f255 tempest-GroupsV320Test-419244652 None] Create group completed successfully. Apr 29 18:17:19 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f" returned: 0 in 0.731s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:19 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f Apr 29 18:17:19 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:20 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-820f63c8-2382-43f3-95e8-1502d18add6f" returned: 0 in 0.579s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-820f63c8-2382-43f3-95e8-1502d18add6f" released by "delete_volume" :: held 1.352s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['dec20c81-b506-4eb3-b032-2a8f06374cfc', '1275aa7d-c6af-40c1-a810-9c423c6c00a9', '9b463703-01ec-4ef6-91ff-87cf69234bea', '12d67780-4dbb-4a0b-b35c-fd221a4f98c3'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:20 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:20 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:20 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Created reservations ['f359ee24-7652-4d10-8997-ced83c6158a6'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:21 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:21 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:21 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:21 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleted volume successfully. Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-14e0794d-2b8b-4aca-abcb-1f44cf92d3af-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-14e0794d-2b8b-4aca-abcb-1f44cf92d3af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fca273a3-bf1a-4b56-85c2-3768ad1ef0d3 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-820f63c8-2382-43f3-95e8-1502d18add6f-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-14e0794d-2b8b-4aca-abcb-1f44cf92d3af" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-14e0794d-2b8b-4aca-abcb-1f44cf92d3af" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleting offline snapshot 14e0794d-2b8b-4aca-abcb-1f44cf92d3af of volume bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] snapshot_file for this snap is: volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997ea48-4287-4b57-9120-5623dd2addfa]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:21 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af Apr 29 18:17:21 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:21 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.676s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:21 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ff803965-8864-4588-a95d-10fb5e9c7657 tempest-GroupsV320Test-419244652 None] Delete group completed successfully. Apr 29 18:17:21 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af" returned: 0 in 0.738s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:17:22 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ea114-68cb-427e-b980-d53f457e8afd]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:22 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 Apr 29 18:17:22 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:22 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:22 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af Apr 29 18:17:22 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:23 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af" returned: 0 in 0.693s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:23 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af Apr 29 18:17:23 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:24 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9.14e0794d-2b8b-4aca-abcb-1f44cf92d3af" returned: 0 in 0.609s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-14e0794d-2b8b-4aca-abcb-1f44cf92d3af" released by "_delete_snapshot" :: held 2.906s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" released by "delete_snapshot" :: held 2.942s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['316f2033-af97-433c-91d1-d68cd80b58bf', 'd31e39b7-1ef6-48e1-8e94-cfdc19d8571d', '28200acd-6939-4585-9c3f-8d053f7a4ecc', '09224d7e-f0fa-4ef6-8052-faa32f63d8f7'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:24 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Delete snapshot completed successfully. Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-14700da7-faa6-4d44-a00e-1ef376ec9b30 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-14e0794d-2b8b-4aca-abcb-1f44cf92d3af-delete_snapshot" released by "delete_snapshot" :: held 3.085s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "cinder-quobyte-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae59b6dc-af5b-42df-97ec-40f4c91161e0]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:24 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 Apr 29 18:17:24 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:25 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" returned: 0 in 0.743s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:25 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9 Apr 29 18:17:25 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:25 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" returned: 0 in 0.629s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-quobyte-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9" released by "delete_volume" :: held 1.444s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:25 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Created reservations ['15bd1296-41a7-47a5-98fb-fa77400b80f3', 'ebd48138-9e12-4edf-b98f-08ad4fa7fd42', '517dbe7b-0b8c-421b-a4e0-cf4cb1fac519', '1928dbc3-8e24-4286-b9f5-1b2e0cf8a460'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:26 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:26 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:26 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.677s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Deleted volume successfully. Apr 29 18:17:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-3264dd56-c737-456d-9ae9-c15e9c794a45 tempest-CreateVolumesFromSnapshotTest-1952438687 None] Lock "cinder-bcbcdd90-dbf8-46a6-a51b-7ed1dc6ef4d9-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Flow 'volume_create_manager' (f2f35d16-9fa9-4d6d-9656-7e49ec60547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c025e8-c928-4adc-b4ba-f7c7c94e96f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c025e8-c928-4adc-b4ba-f7c7c94e96f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2124164438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a4ef4e-3564-4de6-8688-52798e17364a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980b73395ce14fe59325a6cf425a9ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:17:30Z,use_quota=True,user_id='1a1cf694b9d84993812c5e92796a6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89dfd25-7e97-4e00-a5d8-12243fdc48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89dfd25-7e97-4e00-a5d8-12243fdc48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17400478-f39b-42d7-8ebf-79f61264ab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17400478-f39b-42d7-8ebf-79f61264ab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a4ef4e-3564-4de6-8688-52798e17364a', 'volume_name': 'volume-67a4ef4e-3564-4de6-8688-52798e17364a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb36e8a-2d7c-403f-99fb-4a7b05f39697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb36e8a-2d7c-403f-99fb-4a7b05f39697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04bf8ee-ce6b-4eb8-8138-0bd8de08582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Volume 67a4ef4e-3564-4de6-8688-52798e17364a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a4ef4e-3564-4de6-8688-52798e17364a', 'volume_size': 1} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2124164438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a4ef4e-3564-4de6-8688-52798e17364a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980b73395ce14fe59325a6cf425a9ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:17:30Z,use_quota=True,user_id='1a1cf694b9d84993812c5e92796a6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Creating volume 67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:17:30 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:17:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:30 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a 1073741824 Apr 29 18:17:30 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:31 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a 1073741824" returned: 0 in 0.810s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:31 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a Apr 29 18:17:31 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:32 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a" returned: 0 in 0.587s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04bf8ee-ce6b-4eb8-8138-0bd8de08582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a4ef4e-3564-4de6-8688-52798e17364a', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3c3170-73a3-4553-8306-36419cc61e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:32 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Volume volume-67a4ef4e-3564-4de6-8688-52798e17364a (67a4ef4e-3564-4de6-8688-52798e17364a): created successfully Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3c3170-73a3-4553-8306-36419cc61e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Flow 'volume_create_manager' (f2f35d16-9fa9-4d6d-9656-7e49ec60547d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-02132251-0495-4519-9866-c84b65f884a5 tempest-SnapshotMetadataTestJSON-483047518 None] Created volume successfully. Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Creating offline snapshot 7531f66d-fa30-4cd8-82bc-791befe39f95 of volume 67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b29300-5037-454c-887b-44dbda302586]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:32 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a Apr 29 18:17:32 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:33 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a" returned: 0 in 0.771s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:33 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 1G Apr 29 18:17:33 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:34 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 1G" returned: 0 in 0.803s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a4ef4e-3564-4de6-8688-52798e17364a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:34 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a4ef4e-3564-4de6-8688-52798e17364a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 Apr 29 18:17:34 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:35 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a4ef4e-3564-4de6-8688-52798e17364a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95" returned: 0 in 0.639s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:35 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 is being set with open permissions: ugo+rw Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:35 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 Apr 29 18:17:35 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:35 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95" returned: 0 in 0.657s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:35 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info Apr 29 18:17:35 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:35 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:35 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:36 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:36 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info is being set with open permissions: ugo+rw Apr 29 18:17:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:36 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info Apr 29 18:17:36 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:36 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:37 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.info" returned: 0 in 0.655s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.250s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e594d309-0a7e-4f99-b984-ca7f1a0741cd tempest-SnapshotMetadataTestJSON-483047518 None] Create snapshot completed successfully Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "cinder-7531f66d-fa30-4cd8-82bc-791befe39f95-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-7531f66d-fa30-4cd8-82bc-791befe39f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "cinder-quobyte-67a4ef4e-3564-4de6-8688-52798e17364a" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-quobyte-67a4ef4e-3564-4de6-8688-52798e17364a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "cinder-quobyte-7531f66d-fa30-4cd8-82bc-791befe39f95" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-quobyte-7531f66d-fa30-4cd8-82bc-791befe39f95" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Deleting offline snapshot 7531f66d-fa30-4cd8-82bc-791befe39f95 of volume 67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] snapshot_file for this snap is: volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6372bd-c2b0-4f1b-a4a7-e15c456eb81e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:39 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 Apr 29 18:17:39 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:39 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95" returned: 0 in 0.712s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67a4ef4e-3564-4de6-8688-52798e17364a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1aea15-77ac-4133-b523-729ad2dc9e10]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:39 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a Apr 29 18:17:39 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:40 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a" returned: 0 in 0.736s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:40 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 Apr 29 18:17:40 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:41 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95" returned: 0 in 0.705s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:41 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95 Apr 29 18:17:41 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:41 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a.7531f66d-fa30-4cd8-82bc-791befe39f95" returned: 0 in 0.608s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-quobyte-7531f66d-fa30-4cd8-82bc-791befe39f95" released by "_delete_snapshot" :: held 2.871s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-quobyte-67a4ef4e-3564-4de6-8688-52798e17364a" released by "delete_snapshot" :: held 2.894s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:41 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=142,cinder:SELECT=118,cinder:INSERT=39,cinder:DELETE=11 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Created reservations ['29045d8f-6fd6-4c82-9f05-0bbbd1539104', '9801ad92-1ded-4c0b-8476-5b5a0ba773b8', '8855d1b9-2cb3-4f95-9609-dededdb50c33', 'e871fa23-3082-4424-95fb-0e2bc0b88735'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:42 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Delete snapshot completed successfully. Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8255ee9d-e5cb-406f-bfc3-8d120267bd2a tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-7531f66d-fa30-4cd8-82bc-791befe39f95-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "cinder-67a4ef4e-3564-4de6-8688-52798e17364a-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-67a4ef4e-3564-4de6-8688-52798e17364a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "cinder-quobyte-67a4ef4e-3564-4de6-8688-52798e17364a" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-quobyte-67a4ef4e-3564-4de6-8688-52798e17364a" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf40177-04b7-44b2-9d06-41701cb8033b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:42 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a Apr 29 18:17:42 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:43 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a" returned: 0 in 0.770s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:43 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a Apr 29 18:17:43 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:43 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-67a4ef4e-3564-4de6-8688-52798e17364a" returned: 0 in 0.656s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-quobyte-67a4ef4e-3564-4de6-8688-52798e17364a" released by "delete_volume" :: held 1.494s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Created reservations ['62de3817-0e3b-4ada-95e3-995ca86cbb8c', 'a88dbdf1-4987-4f77-b56c-5f0fa61ff85a', 'd0dfc47d-7f99-482e-985b-cb360b54dfe9', 'd7ac8cea-f0d9-4411-bae1-f2b11b8c7a25'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:44 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:17:44 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:44 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.700s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:44 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:17:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Deleted volume successfully. Apr 29 18:17:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d43788f0-d8bf-4d76-a651-fd3510a48c44 tempest-SnapshotMetadataTestJSON-483047518 None] Lock "cinder-67a4ef4e-3564-4de6-8688-52798e17364a-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Flow 'volume_create_manager' (f497e85d-e8c9-4262-a2ef-533eec463396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca507f72-b614-4788-8369-0de8b3cc75ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca507f72-b614-4788-8369-0de8b3cc75ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-483057886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1d4291-07f6-4408-b941-13447037d190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae4895ae36a47eeb37fb66e6926a045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:17:48Z,use_quota=True,user_id='11defadfb8c64d4586c556ca83e792f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb24180-f260-4815-9ed0-d1ee9d7bc313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb24180-f260-4815-9ed0-d1ee9d7bc313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf85dfc-2d47-4669-a92f-bf7794b23dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf85dfc-2d47-4669-a92f-bf7794b23dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1d4291-07f6-4408-b941-13447037d190', 'volume_name': 'volume-ac1d4291-07f6-4408-b941-13447037d190', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3ef5ff-465c-4b81-b2e3-999cea03c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3ef5ff-465c-4b81-b2e3-999cea03c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c8958-6ffb-46f2-b74f-c3609b90c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Volume ac1d4291-07f6-4408-b941-13447037d190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1d4291-07f6-4408-b941-13447037d190', 'volume_size': 1} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-483057886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1d4291-07f6-4408-b941-13447037d190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae4895ae36a47eeb37fb66e6926a045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:17:48Z,use_quota=True,user_id='11defadfb8c64d4586c556ca83e792f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Creating volume ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:17:48 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:48 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 1073741824 Apr 29 18:17:48 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Flow 'volume_create_manager' (a92103b0-7a0e-430a-a96d-5144b6ca33b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea127d5a-aca2-44d0-972d-c7b312ca1336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea127d5a-aca2-44d0-972d-c7b312ca1336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1921720712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad45a750-a8ac-4924-b435-fe26028a1e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e2fdbd08f048feb1e7549fabd7cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:17:49Z,use_quota=True,user_id='edd8b9dfb7334b1cb37cab16e31f36ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae8ce02-2ab4-466b-81ad-9ef96b9655ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae8ce02-2ab4-466b-81ad-9ef96b9655ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df59f455-bbb7-4cfd-bb41-dd95a6e932ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df59f455-bbb7-4cfd-bb41-dd95a6e932ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad45a750-a8ac-4924-b435-fe26028a1e9d', 'volume_name': 'volume-ad45a750-a8ac-4924-b435-fe26028a1e9d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c8835c-6a62-4610-b5d7-7bbd722bb7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c8835c-6a62-4610-b5d7-7bbd722bb7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e783412-93eb-485d-8dbb-c89bfaef945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Volume ad45a750-a8ac-4924-b435-fe26028a1e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad45a750-a8ac-4924-b435-fe26028a1e9d', 'volume_size': 1} Apr 29 18:17:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:49 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 1073741824" returned: 0 in 0.737s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:49 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 Apr 29 18:17:49 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:49 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190" returned: 0 in 0.589s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1921720712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad45a750-a8ac-4924-b435-fe26028a1e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e2fdbd08f048feb1e7549fabd7cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:17:49Z,use_quota=True,user_id='edd8b9dfb7334b1cb37cab16e31f36ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Creating volume ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:17:49 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c8958-6ffb-46f2-b74f-c3609b90c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1d4291-07f6-4408-b941-13447037d190', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:49 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d 1073741824 Apr 29 18:17:49 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a376b50-03fd-455e-952c-0660b1853be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:49 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Volume volume-ac1d4291-07f6-4408-b941-13447037d190 (ac1d4291-07f6-4408-b941-13447037d190): created successfully Apr 29 18:17:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a376b50-03fd-455e-952c-0660b1853be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:50 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Flow 'volume_create_manager' (f497e85d-e8c9-4262-a2ef-533eec463396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:50 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-563585d6-c1bd-4582-adf4-5d3fed91f9f4 tempest-VolumesDeleteCascade-1572262707 None] Created volume successfully. Apr 29 18:17:50 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d 1073741824" returned: 0 in 0.818s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:50 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:17:50 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:51 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.599s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e783412-93eb-485d-8dbb-c89bfaef945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad45a750-a8ac-4924-b435-fe26028a1e9d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e26667-495d-4a72-a42a-361d1bc85f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Creating offline snapshot ad5721fa-f2c9-4d55-ba53-399aa848725a of volume ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f3d8d-f18f-4187-8a07-326119850bea]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:51 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Volume volume-ad45a750-a8ac-4924-b435-fe26028a1e9d (ad45a750-a8ac-4924-b435-fe26028a1e9d): created successfully Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e26667-495d-4a72-a42a-361d1bc85f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:17:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Flow 'volume_create_manager' (a92103b0-7a0e-430a-a96d-5144b6ca33b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:17:51 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b94356ee-97b1-4573-aa2b-efd3852d830f tempest-SnapshotDependencyTests-387990238 None] Created volume successfully. Apr 29 18:17:51 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 Apr 29 18:17:51 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:52 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190" returned: 0 in 0.731s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:52 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a 1G Apr 29 18:17:52 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:52 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a 1G" returned: 0 in 0.729s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1d4291-07f6-4408-b941-13447037d190 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:52 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1d4291-07f6-4408-b941-13447037d190 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:17:52 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:53 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1d4291-07f6-4408-b941-13447037d190 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 0.610s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:53 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a is being set with open permissions: ugo+rw Apr 29 18:17:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:53 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:17:53 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:54 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 0.636s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:54 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info Apr 29 18:17:54 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:54 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info" returned: 0 in 0.601s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:54 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info is being set with open permissions: ugo+rw Apr 29 18:17:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:54 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info Apr 29 18:17:54 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:55 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.info" returned: 0 in 0.577s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.978s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.320s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Creating offline snapshot b880fb0f-1f1c-4ec6-be10-084577f7b49d of volume ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:17:55 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-efdc8729-e9ca-459f-8395-13dc0d8ffba7 tempest-VolumesDeleteCascade-1572262707 None] Create snapshot completed successfully Apr 29 18:17:55 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b042888-ec7c-4073-9383-e9466b583997]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:55 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:17:55 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:56 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.704s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:17:56 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d 1G Apr 29 18:17:56 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:56 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d 1G" returned: 0 in 0.721s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad45a750-a8ac-4924-b435-fe26028a1e9d -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:56 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad45a750-a8ac-4924-b435-fe26028a1e9d -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d Apr 29 18:17:56 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:57 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad45a750-a8ac-4924-b435-fe26028a1e9d -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d" returned: 0 in 0.611s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:57 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d is being set with open permissions: ugo+rw Apr 29 18:17:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:57 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d Apr 29 18:17:57 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:58 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d" returned: 0 in 0.576s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:58 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info Apr 29 18:17:58 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:58 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info" returned: 0 in 0.576s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:58 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info is being set with open permissions: ugo+rw Apr 29 18:17:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:58 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info Apr 29 18:17:58 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:17:59 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 29 18:17:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.info" returned: 0 in 0.564s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:17:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.838s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:17:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.086s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:17:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Creating offline snapshot 114f3042-ee83-4b2b-ba80-570f82744089 of volume ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:17:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e09cfa18-4878-43fe-858b-fb697f1eaa4a tempest-SnapshotDependencyTests-387990238 None] Create snapshot completed successfully Apr 29 18:17:59 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab4db6-5810-45f8-8593-a4d0e2d3ad28]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:17:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:17:59 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:17:59 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:00 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 0.695s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1d4291-07f6-4408-b941-13447037d190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:00 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 1G Apr 29 18:18:00 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:18:00 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 1G" returned: 0 in 0.846s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:00 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 Apr 29 18:18:00 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Flow 'volume_create_manager' (836a098a-8eda-4e78-86d7-a0a08f5c5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f09423-2f5f-4bc9-95d4-5c919d91ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f09423-2f5f-4bc9-95d4-5c919d91ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a30511-8005-4554-ac1e-2083b7e0c4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e2fdbd08f048feb1e7549fabd7cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b880fb0f-1f1c-4ec6-be10-084577f7b49d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:01Z,use_quota=True,user_id='edd8b9dfb7334b1cb37cab16e31f36ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393ef42c-1a2b-40be-9ad7-825ff4eaf466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393ef42c-1a2b-40be-9ad7-825ff4eaf466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4797730-7d58-44f7-bcaa-c20d0b179737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4797730-7d58-44f7-bcaa-c20d0b179737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5a30511-8005-4554-ac1e-2083b7e0c4a6', 'volume_name': 'volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6', 'volume_size': 1, 'snapshot_id': 'b880fb0f-1f1c-4ec6-be10-084577f7b49d'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b047f51a-1941-4435-b083-3455cc5f9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b047f51a-1941-4435-b083-3455cc5f9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74e5da5-2ec7-4d1f-bd33-0e7bc0ecdb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:00 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Volume a5a30511-8005-4554-ac1e-2083b7e0c4a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6', 'volume_size': 1, 'snapshot_id': 'b880fb0f-1f1c-4ec6-be10-084577f7b49d'} Apr 29 18:18:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:01 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089" returned: 0 in 0.641s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:01 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 is being set with open permissions: ugo+rw Apr 29 18:18:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:01 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 Apr 29 18:18:01 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:02 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089" returned: 0 in 0.598s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.170s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-quobyte-b880fb0f-1f1c-4ec6-be10-084577f7b49d-a5a30511-8005-4554-ac1e-2083b7e0c4a6" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-b880fb0f-1f1c-4ec6-be10-084577f7b49d-a5a30511-8005-4554-ac1e-2083b7e0c4a6" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Creating volume a5a30511-8005-4554-ac1e-2083b7e0c4a6 from snapshot b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-quobyte-a5a30511-8005-4554-ac1e-2083b7e0c4a6" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-797a05e8-7cd9-4a09-a980-4cc760439c66 tempest-VolumesDeleteCascade-1572262707 None] Create snapshot completed successfully Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-a5a30511-8005-4554-ac1e-2083b7e0c4a6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] snapshot: b880fb0f-1f1c-4ec6-be10-084577f7b49d, volume: a5a30511-8005-4554-ac1e-2083b7e0c4a6, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e967789a-b123-408d-9b89-74b5760a28c1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:02 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d Apr 29 18:18:02 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-ac1d4291-07f6-4408-b941-13447037d190-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-ac1d4291-07f6-4408-b941-13447037d190-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Performing cascade delete. {{(pid=84402) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-114f3042-ee83-4b2b-ba80-570f82744089-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-114f3042-ee83-4b2b-ba80-570f82744089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-114f3042-ee83-4b2b-ba80-570f82744089" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-114f3042-ee83-4b2b-ba80-570f82744089" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Deleting offline snapshot 114f3042-ee83-4b2b-ba80-570f82744089 of volume ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] snapshot_file for this snap is: volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[24befe9e-13a3-40b4-aa26-878cf6627a5b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:02 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 Apr 29 18:18:02 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:03 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d" returned: 0 in 0.758s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad45a750-a8ac-4924-b435-fe26028a1e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c9ac26-859c-4417-8f1a-a6741e6754b3]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:03 devstack sudo[92033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:18:03 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:03 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089" returned: 0 in 0.756s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1d4291-07f6-4408-b941-13447037d190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4baff5-98b2-498f-b9e8-47297e8aaadd]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:03 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:18:03 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:03 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.727s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:18:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:03 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 Apr 29 18:18:03 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:04 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 0.736s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1d4291-07f6-4408-b941-13447037d190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:04 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 Apr 29 18:18:04 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:05 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089" returned: 0 in 1.146s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:05 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089 Apr 29 18:18:05 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:07 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.114f3042-ee83-4b2b-ba80-570f82744089" returned: 0 in 2.248s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-114f3042-ee83-4b2b-ba80-570f82744089" released by "_delete_snapshot" :: held 5.042s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" released by "delete_snapshot" :: held 5.074s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Created reservations ['64d574e4-4aee-4a77-93e9-8bf7f29cbe9f', 'ce058fe2-a222-43d4-ace6-2ffe3d862548', '89e103be-90d2-4b8e-a03c-215fb6391413', 'be71be18-f330-4cb6-aa15-690b0095a8a6'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:07 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Delete snapshot completed successfully. Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-114f3042-ee83-4b2b-ba80-570f82744089-delete_snapshot" released by "delete_snapshot" :: held 5.314s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-ad5721fa-f2c9-4d55-ba53-399aa848725a-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-ad5721fa-f2c9-4d55-ba53-399aa848725a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-ad5721fa-f2c9-4d55-ba53-399aa848725a" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ad5721fa-f2c9-4d55-ba53-399aa848725a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Deleting offline snapshot ad5721fa-f2c9-4d55-ba53-399aa848725a of volume ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:18:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] snapshot_file for this snap is: volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:18:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d5d871-3614-4c83-8b45-133b6ab67e10]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:08 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:18:08 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:08 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6" returned: 0 in 5.068s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff642a37-af8b-4974-b15f-bc71abb937f7]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:08 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:18:08 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:09 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 1.104s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1d4291-07f6-4408-b941-13447037d190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12d8ba-6dea-4a7f-ba97-607d86279055]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:09 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 Apr 29 18:18:09 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:09 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.864s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:18:09 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Converted 1024.00 MB image at 201.97 MB/s Apr 29 18:18:09 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 is being set with open permissions: ugo+rw Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:09 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 Apr 29 18:18:09 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:09 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190" returned: 0 in 0.769s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:10 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:18:10 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:10 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6" returned: 0 in 0.627s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-a5a30511-8005-4554-ac1e-2083b7e0c4a6" released by "_copy_volume_from_snapshot" :: held 8.142s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-b880fb0f-1f1c-4ec6-be10-084577f7b49d-a5a30511-8005-4554-ac1e-2083b7e0c4a6" released by "_create_volume_from_snapshot" :: held 8.174s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.198s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74e5da5-2ec7-4d1f-bd33-0e7bc0ecdb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6', 'volume_size': 1, 'snapshot_id': 'b880fb0f-1f1c-4ec6-be10-084577f7b49d'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6495c3-ff00-47f9-a9bd-14d7d8a49889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Volume volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 (a5a30511-8005-4554-ac1e-2083b7e0c4a6): created successfully Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6495c3-ff00-47f9-a9bd-14d7d8a49889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Flow 'volume_create_manager' (836a098a-8eda-4e78-86d7-a0a08f5c5062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4fdceaae-031d-4489-b656-f770a5e47d02 tempest-SnapshotDependencyTests-387990238 None] Created volume successfully. Apr 29 18:18:10 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 0.716s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:10 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a Apr 29 18:18:10 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-b880fb0f-1f1c-4ec6-be10-084577f7b49d-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-b880fb0f-1f1c-4ec6-be10-084577f7b49d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-quobyte-ad45a750-a8ac-4924-b435-fe26028a1e9d" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-ad45a750-a8ac-4924-b435-fe26028a1e9d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-quobyte-b880fb0f-1f1c-4ec6-be10-084577f7b49d" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-b880fb0f-1f1c-4ec6-be10-084577f7b49d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Deleting offline snapshot b880fb0f-1f1c-4ec6-be10-084577f7b49d of volume ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] snapshot_file for this snap is: volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ebd09b-36f7-4db4-828d-7eec1338157b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:11 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d Apr 29 18:18:11 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:11 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190.ad5721fa-f2c9-4d55-ba53-399aa848725a" returned: 0 in 0.593s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ad5721fa-f2c9-4d55-ba53-399aa848725a" released by "_delete_snapshot" :: held 3.357s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" released by "delete_snapshot" :: held 3.401s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Created reservations ['11fa6931-fd38-4550-88a1-fd86726a9f74', '8b0a67f2-f33e-434b-8c0e-6050a2d5c30c', '92c04487-2bff-4653-8a85-c10156c0de82', 'f3c3b3be-1795-4281-a6df-edc420905f1b'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:11 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Delete snapshot completed successfully. Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-ad5721fa-f2c9-4d55-ba53-399aa848725a-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Snapshots deleted, issuing volume delete {{(pid=84402) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e6897-94b1-4b7a-9d6e-24cd7dccc07e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:11 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 Apr 29 18:18:11 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:11 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad45a750-a8ac-4924-b435-fe26028a1e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc528f9b-491b-4eb3-a425-f6025af53a51]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:11 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:18:11 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:12 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190" returned: 0 in 0.735s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:12 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190 Apr 29 18:18:12 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:12 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.722s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:12 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d Apr 29 18:18:12 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:12 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ac1d4291-07f6-4408-b941-13447037d190" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-ac1d4291-07f6-4408-b941-13447037d190" released by "delete_volume" :: held 1.429s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:12 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Created reservations ['3781c490-a64f-4065-b50a-b875b07e8544', '426e2ef2-4521-4c25-94cc-e37aab5b5f8d', 'be8a0560-b5df-43ca-b571-ce33f9b1d3ab', 'ea3b6e5b-e617-4857-a5a8-8ab6a58a6d53'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:13 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:13 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:13 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d" returned: 0 in 0.759s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:13 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d Apr 29 18:18:13 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:13 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.670s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:13 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Deleted volume successfully. Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-97c774b0-1b8f-475a-a06b-e6a7ccf103ef tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-ac1d4291-07f6-4408-b941-13447037d190-delete_volume" released by "delete_volume" :: held 11.323s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:13 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d.b880fb0f-1f1c-4ec6-be10-084577f7b49d" returned: 0 in 0.666s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-b880fb0f-1f1c-4ec6-be10-084577f7b49d" released by "_delete_snapshot" :: held 3.019s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-ad45a750-a8ac-4924-b435-fe26028a1e9d" released by "delete_snapshot" :: held 3.048s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=89,cinder:UPDATE=87,cinder:DELETE=7,cinder:INSERT=24 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:18:13 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Created reservations ['e28c64be-9fc0-4fb4-be59-cde191a8f2b7', '5c673540-dfdc-4088-a46e-ece00eea90c5', 'bdfd073f-cd61-478f-9a02-fe7d1730cfb9', '6bfbe2a8-7f6d-4c5e-a9e0-e6794af53d54'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:14 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Delete snapshot completed successfully. Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1f5fa9c9-cd75-41e5-ae05-6b06ef85afea tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-b880fb0f-1f1c-4ec6-be10-084577f7b49d-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Flow 'volume_create_manager' (4ab21d0b-a4d4-4ab0-aee4-47802be8be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be37f24-f7d7-40fe-b591-d183523ac606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be37f24-f7d7-40fe-b591-d183523ac606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1482853774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3a60b1-117c-4e5c-a5bf-98a70f1354ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae4895ae36a47eeb37fb66e6926a045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:14Z,use_quota=True,user_id='11defadfb8c64d4586c556ca83e792f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d1cf3f-5ba1-46a7-9cb5-9e25fa55421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d1cf3f-5ba1-46a7-9cb5-9e25fa55421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1498e61c-2fab-4c87-aeb1-6d6ba1df3513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1498e61c-2fab-4c87-aeb1-6d6ba1df3513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3a60b1-117c-4e5c-a5bf-98a70f1354ba', 'volume_name': 'volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec888e8-fdca-4991-aafc-ddbf62aca4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec888e8-fdca-4991-aafc-ddbf62aca4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e8b209-5097-4be4-b505-c82622fdc17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:14 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Volume 0c3a60b1-117c-4e5c-a5bf-98a70f1354ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba', 'volume_size': 1} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1482853774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3a60b1-117c-4e5c-a5bf-98a70f1354ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae4895ae36a47eeb37fb66e6926a045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:14Z,use_quota=True,user_id='11defadfb8c64d4586c556ca83e792f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Creating volume 0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:18:14 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:18:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:14 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba 1073741824 Apr 29 18:18:14 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-ad45a750-a8ac-4924-b435-fe26028a1e9d-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:15 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba 1073741824" returned: 0 in 0.810s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-ad45a750-a8ac-4924-b435-fe26028a1e9d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-quobyte-ad45a750-a8ac-4924-b435-fe26028a1e9d" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-ad45a750-a8ac-4924-b435-fe26028a1e9d" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:15 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:15 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b95cb28-7f5a-46ff-9618-d86925089dbb]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:15 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:18:15 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:15 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.642s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e8b209-5097-4be4-b505-c82622fdc17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c76935-7b91-43e7-8ef5-9803f959e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:15 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Volume volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba (0c3a60b1-117c-4e5c-a5bf-98a70f1354ba): created successfully Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c76935-7b91-43e7-8ef5-9803f959e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Flow 'volume_create_manager' (4ab21d0b-a4d4-4ab0-aee4-47802be8be4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-64d0b8ae-f877-4800-8447-e6492b7323ac tempest-VolumesDeleteCascade-1572262707 None] Created volume successfully. Apr 29 18:18:15 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.729s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:15 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d Apr 29 18:18:15 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Creating offline snapshot a916cebe-d0e0-483e-82c6-1047d1b75708 of volume 0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5439c9f-0d9b-4976-8611-efe1703c2fe1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:16 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad45a750-a8ac-4924-b435-fe26028a1e9d" returned: 0 in 0.619s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-ad45a750-a8ac-4924-b435-fe26028a1e9d" released by "delete_volume" :: held 1.420s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Created reservations ['2d80900b-8cd0-4b47-97a0-bd82f1bc2f25', '4fd1d608-9355-4ae0-bca7-a6d3d07de6bf', '1fcb52de-fa7d-4a8c-a169-6431ab1a10b8', 'c60ab991-b912-4e48-9e3e-8b744f2fe211'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:16 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:16 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:16 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:16 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:17 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.732s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:17 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 1G Apr 29 18:18:17 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-a5a30511-8005-4554-ac1e-2083b7e0c4a6-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:17 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.636s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Deleted volume successfully. Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-a5a30511-8005-4554-ac1e-2083b7e0c4a6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b084fe41-6ff2-4188-8bff-9f677d9d94d2 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-ad45a750-a8ac-4924-b435-fe26028a1e9d-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "cinder-quobyte-a5a30511-8005-4554-ac1e-2083b7e0c4a6" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-a5a30511-8005-4554-ac1e-2083b7e0c4a6" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[55950936-e48a-4526-866f-edeaff59b120]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:17 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 Apr 29 18:18:17 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:17 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 1G" returned: 0 in 0.736s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:17 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 Apr 29 18:18:17 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:18 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6" returned: 0 in 0.796s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:18 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6 Apr 29 18:18:18 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:18 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708" returned: 0 in 0.618s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:18 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 is being set with open permissions: ugo+rw Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:18 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 Apr 29 18:18:18 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:18 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-a5a30511-8005-4554-ac1e-2083b7e0c4a6" returned: 0 in 0.629s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-quobyte-a5a30511-8005-4554-ac1e-2083b7e0c4a6" released by "delete_volume" :: held 1.468s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Created reservations ['58fcd107-6ae8-4eb2-9ebd-12bcba1bddf3', 'f770ea9d-ae7e-4362-9fdb-8bd206b2b2c7', '4bcc504a-0a2a-4735-95de-b4724cd2e33e', '6192aa65-7a5b-4746-9180-5ff186062b42'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:18 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:18 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:19 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708" returned: 0 in 0.572s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:19 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info Apr 29 18:18:19 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:19 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.632s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Deleted volume successfully. Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f38e701f-18ed-4e0b-8db8-66a8d5e14467 tempest-SnapshotDependencyTests-387990238 None] Lock "cinder-a5a30511-8005-4554-ac1e-2083b7e0c4a6-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:19 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info" returned: 0 in 0.581s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:19 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info is being set with open permissions: ugo+rw Apr 29 18:18:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:19 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info Apr 29 18:18:19 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:20 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.info" returned: 0 in 0.634s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.981s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-cb06177f-286d-4dbc-a514-7678b7fe8e14 tempest-VolumesDeleteCascade-1572262707 None] Create snapshot completed successfully Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Flow 'volume_create_manager' (7ec69b5d-b408-4c70-ae8c-fa4ce41dc323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb41115-3065-42bc-bd40-da6e3aa7c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb41115-3065-42bc-bd40-da6e3aa7c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-637388496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed47e0c-1d37-46c2-8fe9-757fe3b52e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae4895ae36a47eeb37fb66e6926a045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a916cebe-d0e0-483e-82c6-1047d1b75708,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:21Z,use_quota=True,user_id='11defadfb8c64d4586c556ca83e792f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cbd238-2b74-4a1d-9fae-913388ae56c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cbd238-2b74-4a1d-9fae-913388ae56c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4822537-d382-4f25-b6ae-f255fe037344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4822537-d382-4f25-b6ae-f255fe037344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ed47e0c-1d37-46c2-8fe9-757fe3b52e61', 'volume_name': 'volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61', 'volume_size': 1, 'snapshot_id': 'a916cebe-d0e0-483e-82c6-1047d1b75708'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e05615-b9ea-44e8-80b3-e9a3f766a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e05615-b9ea-44e8-80b3-e9a3f766a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35221b69-489c-46ca-96b4-59be9d9724f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:21 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Volume 4ed47e0c-1d37-46c2-8fe9-757fe3b52e61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61', 'volume_size': 1, 'snapshot_id': 'a916cebe-d0e0-483e-82c6-1047d1b75708'} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-a916cebe-d0e0-483e-82c6-1047d1b75708-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-a916cebe-d0e0-483e-82c6-1047d1b75708-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Creating volume 4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 from snapshot a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] snapshot: a916cebe-d0e0-483e-82c6-1047d1b75708, volume: 4ed47e0c-1d37-46c2-8fe9-757fe3b52e61, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[640eeb1c-bd26-4149-ade5-3176669dbb5f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:21 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 Apr 29 18:18:21 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:22 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708" returned: 0 in 0.745s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[0176be57-6584-4604-85d8-f99006ecd11b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:22 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:22 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:22 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.788s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:18:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:22 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 Apr 29 18:18:22 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:27 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" returned: 0 in 5.029s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:27 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a42a76-fcdf-4e0c-b11e-8e3fb691a439]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:27 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:27 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:28 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.894s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:28 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:18:28 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Converted 1024.00 MB image at 203.58 MB/s Apr 29 18:18:28 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 is being set with open permissions: ugo+rw Apr 29 18:18:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:28 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 Apr 29 18:18:28 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:29 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" released by "_copy_volume_from_snapshot" :: held 8.208s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-a916cebe-d0e0-483e-82c6-1047d1b75708-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" released by "_create_volume_from_snapshot" :: held 8.238s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.253s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35221b69-489c-46ca-96b4-59be9d9724f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61', 'volume_size': 1, 'snapshot_id': 'a916cebe-d0e0-483e-82c6-1047d1b75708'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc0f749-f39f-479b-a575-dad5c9e7912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:29 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Volume volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 (4ed47e0c-1d37-46c2-8fe9-757fe3b52e61): created successfully Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc0f749-f39f-479b-a575-dad5c9e7912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Flow 'volume_create_manager' (7ec69b5d-b408-4c70-ae8c-fa4ce41dc323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-216768e4-1132-477c-9186-80c2917ac3d3 tempest-VolumesDeleteCascade-1572262707 None] Created volume successfully. Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Performing cascade delete. {{(pid=84402) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-a916cebe-d0e0-483e-82c6-1047d1b75708-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-a916cebe-d0e0-483e-82c6-1047d1b75708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-a916cebe-d0e0-483e-82c6-1047d1b75708" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-a916cebe-d0e0-483e-82c6-1047d1b75708" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Deleting offline snapshot a916cebe-d0e0-483e-82c6-1047d1b75708 of volume 0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] snapshot_file for this snap is: volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e74982f-7f04-4b6d-ac8f-73cccbddf940]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:30 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 Apr 29 18:18:30 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:30 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708" returned: 0 in 0.763s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:18:31 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33beabd-7fd8-4a1e-8b60-075fec2e10d6]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:31 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:31 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:31 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.687s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:31 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 Apr 29 18:18:31 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:32 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708" returned: 0 in 0.652s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:32 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708 Apr 29 18:18:32 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:32 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba.a916cebe-d0e0-483e-82c6-1047d1b75708" returned: 0 in 0.580s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-a916cebe-d0e0-483e-82c6-1047d1b75708" released by "_delete_snapshot" :: held 2.773s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" released by "delete_snapshot" :: held 2.794s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Created reservations ['462fc441-d863-423a-a9f6-476665e609f7', 'de9d6bae-e279-41df-9555-91ab71921378', '45e11337-3483-4654-b787-bf466bda1ba4', '5fe81a41-6dd6-4bf9-8f02-10eff20991ef'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Delete snapshot completed successfully. Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-a916cebe-d0e0-483e-82c6-1047d1b75708-delete_snapshot" released by "delete_snapshot" :: held 2.924s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Snapshots deleted, issuing volume delete {{(pid=84402) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" acquired by "delete_volume" :: waited 0.012s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8808be-d90d-472d-939f-ebcfff35934a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:33 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:33 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:33 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.689s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:33 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba Apr 29 18:18:33 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:34 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" returned: 0 in 0.572s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba" released by "delete_volume" :: held 1.315s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Created reservations ['efcfee4d-b5e1-4781-8eb7-0f79cd0fa5cc', '8087aa2b-15ce-49cc-ba0c-d30563e90bd8', '568f1b56-74b3-4718-9413-2484a3d5e3dc', '60fadcfe-70f3-4353-a31a-af16874b0c1b'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:34 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:34 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:35 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.569s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:35 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Deleted volume successfully. Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-393cdaf4-a283-4699-b6e4-05a10cfe8bf5 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-0c3a60b1-117c-4e5c-a5bf-98a70f1354ba-delete_volume" released by "delete_volume" :: held 5.009s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "cinder-quobyte-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1133bf-588a-46ac-ab25-baa6ea2ddc3d]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:35 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 Apr 29 18:18:35 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:35 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:35 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:36 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" returned: 0 in 0.727s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:36 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61 Apr 29 18:18:36 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:36 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.603s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:36 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" returned: 0 in 0.564s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-quobyte-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61" released by "delete_volume" :: held 1.329s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:36 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Created reservations ['a5a14e7d-0407-4332-8ab1-683fde361afb', 'aefbabce-e453-4353-8065-89300e6a2def', '6834e4c7-3e5d-42c7-a84a-04e70e71991b', '09bea63c-89ff-4d66-ac5f-565cc5e5686c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:37 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:37 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:37 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.559s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Deleted volume successfully. Apr 29 18:18:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1d0103d3-4b35-409b-8940-19e9d4ae4d90 tempest-VolumesDeleteCascade-1572262707 None] Lock "cinder-4ed47e0c-1d37-46c2-8fe9-757fe3b52e61-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Flow 'volume_create_manager' (b7dc5786-5fc6-4d8d-8444-99dba3746c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d4f9fe-31dd-4efa-b817-72ea7d223ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d4f9fe-31dd-4efa-b817-72ea7d223ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-247307269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa45d541-bcfb-4318-80da-6f317e99e31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f0a0f4f634e328fc3f98697be0c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:41Z,use_quota=True,user_id='e988f20105ef4ae5a41570833a91b4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e552a4-f54f-4c77-81e7-91b3a01e8169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e552a4-f54f-4c77-81e7-91b3a01e8169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57d4020-9500-45c9-93fb-6ad402487376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57d4020-9500-45c9-93fb-6ad402487376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa45d541-bcfb-4318-80da-6f317e99e31d', 'volume_name': 'volume-aa45d541-bcfb-4318-80da-6f317e99e31d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604d28b2-8252-4f10-9a03-cc6bba5730a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604d28b2-8252-4f10-9a03-cc6bba5730a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dd6ea0-05d9-41cb-98af-7f0b2b5e4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Volume aa45d541-bcfb-4318-80da-6f317e99e31d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa45d541-bcfb-4318-80da-6f317e99e31d', 'volume_size': 1} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-247307269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa45d541-bcfb-4318-80da-6f317e99e31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f0a0f4f634e328fc3f98697be0c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:41Z,use_quota=True,user_id='e988f20105ef4ae5a41570833a91b4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Creating volume aa45d541-bcfb-4318-80da-6f317e99e31d {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:18:41 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:18:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:41 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d 1073741824 Apr 29 18:18:41 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:42 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d 1073741824" returned: 0 in 0.756s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=81,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=10 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:42 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d Apr 29 18:18:42 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:42 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d" returned: 0 in 0.592s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dd6ea0-05d9-41cb-98af-7f0b2b5e4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa45d541-bcfb-4318-80da-6f317e99e31d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d9b33f-bfec-467f-b16c-cbef5ff47929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:43 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Volume volume-aa45d541-bcfb-4318-80da-6f317e99e31d (aa45d541-bcfb-4318-80da-6f317e99e31d): created successfully Apr 29 18:18:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d9b33f-bfec-467f-b16c-cbef5ff47929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:43 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Flow 'volume_create_manager' (b7dc5786-5fc6-4d8d-8444-99dba3746c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5735c40e-3a9d-4bba-adde-1e716062fa8c tempest-VolumesTransfersTest-1832810367 None] Created volume successfully. Apr 29 18:18:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-12c5dc49-1f17-457a-8999-aa3881b683ab tempest-VolumesTransfersTest-574906159 None] Transfer volume completed successfully. Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Acquiring lock "cinder-aa45d541-bcfb-4318-80da-6f317e99e31d-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-aa45d541-bcfb-4318-80da-6f317e99e31d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Acquiring lock "cinder-quobyte-aa45d541-bcfb-4318-80da-6f317e99e31d" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-quobyte-aa45d541-bcfb-4318-80da-6f317e99e31d" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dcc615-5ff7-4765-8489-125460f59f52]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:45 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d Apr 29 18:18:45 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:45 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d" returned: 0 in 0.677s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:45 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d Apr 29 18:18:45 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:46 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-aa45d541-bcfb-4318-80da-6f317e99e31d" returned: 0 in 0.572s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-quobyte-aa45d541-bcfb-4318-80da-6f317e99e31d" released by "delete_volume" :: held 1.284s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Created reservations ['3a30bdd8-8b74-469d-b096-2cbde869e3b3', 'f4cd9cb8-72e6-41ba-963a-ae534b47961a', '37c636da-cbf4-4460-a6b1-8610a7006ad0', 'c1bdaa6d-295b-47fa-af32-b54aaf031375'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:46 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:46 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:47 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.566s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Deleted volume successfully. Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b380ec7d-cc06-489f-8179-1222a23fdfff tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-aa45d541-bcfb-4318-80da-6f317e99e31d-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Flow 'volume_create_manager' (cd4d97b0-f8c8-4196-9bcb-de016e4dc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709924b8-f07f-4061-a3c2-894a1bbc0032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709924b8-f07f-4061-a3c2-894a1bbc0032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1323138688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7536c13a-f78a-4891-b647-78f41b9990f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f0a0f4f634e328fc3f98697be0c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:48Z,use_quota=True,user_id='e988f20105ef4ae5a41570833a91b4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363e9a23-d225-4f22-acf8-180854c0d1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363e9a23-d225-4f22-acf8-180854c0d1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c468fcf-d8e6-4875-b570-3dde3e19fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c468fcf-d8e6-4875-b570-3dde3e19fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7536c13a-f78a-4891-b647-78f41b9990f4', 'volume_name': 'volume-7536c13a-f78a-4891-b647-78f41b9990f4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e72a55-e6a4-4de9-999f-32e08fad3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e72a55-e6a4-4de9-999f-32e08fad3267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6193fe9-3038-40f1-98ee-3432e4cd2790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:47 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Volume 7536c13a-f78a-4891-b647-78f41b9990f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7536c13a-f78a-4891-b647-78f41b9990f4', 'volume_size': 1} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1323138688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7536c13a-f78a-4891-b647-78f41b9990f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f0a0f4f634e328fc3f98697be0c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:48Z,use_quota=True,user_id='e988f20105ef4ae5a41570833a91b4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Creating volume 7536c13a-f78a-4891-b647-78f41b9990f4 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:18:47 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:18:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:47 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 1073741824 Apr 29 18:18:47 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:48 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 1073741824" returned: 0 in 0.752s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:48 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 Apr 29 18:18:48 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:49 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4" returned: 0 in 0.582s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6193fe9-3038-40f1-98ee-3432e4cd2790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7536c13a-f78a-4891-b647-78f41b9990f4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738a3d0f-b7c4-4c5f-8a12-06a76a6045af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:49 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Volume volume-7536c13a-f78a-4891-b647-78f41b9990f4 (7536c13a-f78a-4891-b647-78f41b9990f4): created successfully Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738a3d0f-b7c4-4c5f-8a12-06a76a6045af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Flow 'volume_create_manager' (cd4d97b0-f8c8-4196-9bcb-de016e4dc65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7e2b6ec2-ac5b-4a49-a049-f03365255f5a tempest-VolumesTransfersTest-1832810367 None] Created volume successfully. Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Acquiring lock "cinder-7536c13a-f78a-4891-b647-78f41b9990f4-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-7536c13a-f78a-4891-b647-78f41b9990f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Acquiring lock "cinder-quobyte-7536c13a-f78a-4891-b647-78f41b9990f4" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-quobyte-7536c13a-f78a-4891-b647-78f41b9990f4" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ea549-590d-4464-bd17-f7bfafb4eee5]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:50 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 Apr 29 18:18:50 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:50 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4" returned: 0 in 0.680s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:50 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4 Apr 29 18:18:50 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:51 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-7536c13a-f78a-4891-b647-78f41b9990f4" returned: 0 in 0.568s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-quobyte-7536c13a-f78a-4891-b647-78f41b9990f4" released by "delete_volume" :: held 1.288s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Created reservations ['c70d6a3e-b5bc-4f19-b0a3-be072ec6ade8', 'bf5f3b3d-763a-49ac-b557-7060d9d7384e', '0205028c-390d-4eac-a869-054db807e1a7', 'd756131e-23dd-44a4-a3d6-faf20986d40e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:51 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:18:51 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:52 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.584s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:52 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:18:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Deleted volume successfully. Apr 29 18:18:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-99b1ffd5-53b5-4ecd-84b2-2494da5044af tempest-VolumesTransfersTest-2113326347 None] Lock "cinder-7536c13a-f78a-4891-b647-78f41b9990f4-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Flow 'volume_create_manager' (38c55589-9456-4c78-981b-0d56e2d1644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91ce272-7859-4754-a69b-a92896e35580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91ce272-7859-4754-a69b-a92896e35580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-517515515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ac8879-84fd-4ed7-89a2-522a57d52199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0144afd95b8b42aaa86a5e0fcb3bb5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:58Z,use_quota=True,user_id='7326ff9bd6d7476992e794fecd228f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762e8fd2-c74f-40ec-adf4-61ed7ab0c56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762e8fd2-c74f-40ec-adf4-61ed7ab0c56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:57 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d595f23-3682-4636-aacf-89a10fd1030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d595f23-3682-4636-aacf-89a10fd1030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ac8879-84fd-4ed7-89a2-522a57d52199', 'volume_name': 'volume-16ac8879-84fd-4ed7-89a2-522a57d52199', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee84643-4c3c-4167-b0ca-5fdf257ac1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee84643-4c3c-4167-b0ca-5fdf257ac1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2888d8e8-41a5-44cf-bfcf-94d022357315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:58 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Volume 16ac8879-84fd-4ed7-89a2-522a57d52199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ac8879-84fd-4ed7-89a2-522a57d52199', 'volume_size': 1} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-517515515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ac8879-84fd-4ed7-89a2-522a57d52199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0144afd95b8b42aaa86a5e0fcb3bb5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:18:58Z,use_quota=True,user_id='7326ff9bd6d7476992e794fecd228f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Creating volume 16ac8879-84fd-4ed7-89a2-522a57d52199 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:18:58 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:58 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 1073741824 Apr 29 18:18:58 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:58 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 1073741824" returned: 0 in 0.738s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:18:58 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 Apr 29 18:18:58 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:18:59 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199" returned: 0 in 0.579s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2888d8e8-41a5-44cf-bfcf-94d022357315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ac8879-84fd-4ed7-89a2-522a57d52199', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63be2d43-a71a-4d57-9a0a-40ec4b323c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:18:59 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Volume volume-16ac8879-84fd-4ed7-89a2-522a57d52199 (16ac8879-84fd-4ed7-89a2-522a57d52199): created successfully Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63be2d43-a71a-4d57-9a0a-40ec4b323c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:18:59 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Flow 'volume_create_manager' (38c55589-9456-4c78-981b-0d56e2d1644e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:18:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-625c4c43-7a95-4efd-be42-f7dabb071ff4 tempest-VolumesTransfersV355Test-50090959 None] Created volume successfully. Apr 29 18:19:00 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-852394c9-2f6b-4ced-a896-f1fa9a050013 tempest-VolumesTransfersV355Test-70252793 None] Transfer volume completed successfully. Apr 29 18:19:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Acquiring lock "cinder-16ac8879-84fd-4ed7-89a2-522a57d52199-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-16ac8879-84fd-4ed7-89a2-522a57d52199-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Acquiring lock "cinder-quobyte-16ac8879-84fd-4ed7-89a2-522a57d52199" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-quobyte-16ac8879-84fd-4ed7-89a2-522a57d52199" acquired by "delete_volume" :: waited 0.012s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:01 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[312cd2e9-8be4-446d-8125-9d04720e1d4f]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:19:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:01 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 Apr 29 18:19:01 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:02 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199" returned: 0 in 0.676s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:02 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199 Apr 29 18:19:02 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:02 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-16ac8879-84fd-4ed7-89a2-522a57d52199" returned: 0 in 0.572s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-quobyte-16ac8879-84fd-4ed7-89a2-522a57d52199" released by "delete_volume" :: held 1.291s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Created reservations ['d051d283-889c-4892-9649-84fe3ec59c8b', '0496f16b-68f9-44fc-ba98-7c7c9eccdd2e', '7c1a9b81-9b68-4724-ac3d-0823da5457f4', 'ca2b70a4-aeca-4a71-afaa-408a0c844672'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:02 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:19:02 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:03 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.559s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:03 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:19:03 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Deleted volume successfully. Apr 29 18:19:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8bd60d3e-fe3d-4af1-9e46-38249a75a0e9 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-16ac8879-84fd-4ed7-89a2-522a57d52199-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:03 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Flow 'volume_create_manager' (d9f06d7f-91ba-4452-a47e-f94914cd0c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bfbdbe-28be-409a-b049-573f0d9307d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bfbdbe-28be-409a-b049-573f0d9307d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2088221616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecbd5b9-2a60-4354-8275-ed323cd14a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0144afd95b8b42aaa86a5e0fcb3bb5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:04Z,use_quota=True,user_id='7326ff9bd6d7476992e794fecd228f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da701dc1-c57b-411e-a2db-70b4f6c06098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da701dc1-c57b-411e-a2db-70b4f6c06098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ceaa36-5796-4067-b90a-d2a42d0feb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ceaa36-5796-4067-b90a-d2a42d0feb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecbd5b9-2a60-4354-8275-ed323cd14a00', 'volume_name': 'volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858e7a57-a934-4dc9-ae09-f22ec9ca8ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858e7a57-a934-4dc9-ae09-f22ec9ca8ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba1f537-cca1-4fe3-ae20-2682f5396e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:04 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Volume 2ecbd5b9-2a60-4354-8275-ed323cd14a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00', 'volume_size': 1} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2088221616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecbd5b9-2a60-4354-8275-ed323cd14a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0144afd95b8b42aaa86a5e0fcb3bb5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:04Z,use_quota=True,user_id='7326ff9bd6d7476992e794fecd228f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Creating volume 2ecbd5b9-2a60-4354-8275-ed323cd14a00 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:19:04 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:04 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 1073741824 Apr 29 18:19:04 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:04 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 1073741824" returned: 0 in 0.740s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:04 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 Apr 29 18:19:04 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:05 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00" returned: 0 in 0.575s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba1f537-cca1-4fe3-ae20-2682f5396e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c02df3-a02b-411d-a3f6-689254661dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:05 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Volume volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 (2ecbd5b9-2a60-4354-8275-ed323cd14a00): created successfully Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c02df3-a02b-411d-a3f6-689254661dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Flow 'volume_create_manager' (d9f06d7f-91ba-4452-a47e-f94914cd0c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:05 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a2f6252d-b712-42e1-84ba-b6c1234c575f tempest-VolumesTransfersV355Test-50090959 None] Created volume successfully. Apr 29 18:19:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Acquiring lock "cinder-2ecbd5b9-2a60-4354-8275-ed323cd14a00-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-2ecbd5b9-2a60-4354-8275-ed323cd14a00-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Acquiring lock "cinder-quobyte-2ecbd5b9-2a60-4354-8275-ed323cd14a00" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-quobyte-2ecbd5b9-2a60-4354-8275-ed323cd14a00" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d84701-0811-4b86-b856-0a3e93153522]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:19:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:06 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 Apr 29 18:19:06 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:07 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00" returned: 0 in 0.705s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:07 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00 Apr 29 18:19:07 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:07 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2ecbd5b9-2a60-4354-8275-ed323cd14a00" returned: 0 in 0.578s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-quobyte-2ecbd5b9-2a60-4354-8275-ed323cd14a00" released by "delete_volume" :: held 1.323s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Created reservations ['523bc951-d13e-42c4-9cff-d863b421783c', '5bf48792-5a4f-487b-8933-24442c84b5c7', 'bd77d4d1-3705-4f8d-a4cc-cd06d6ed5f9a', '8763f003-ddbd-42e2-b8a7-a57940d525b1'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:07 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:19:07 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:08 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.576s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:08 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:19:08 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Deleted volume successfully. Apr 29 18:19:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b315e2b5-a85f-4cbc-8117-3fbcc0f4d638 tempest-VolumesTransfersV355Test-1888284105 None] Lock "cinder-2ecbd5b9-2a60-4354-8275-ed323cd14a00-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:INSERT=19,cinder:UPDATE=92,cinder:SELECT=64,cinder:DELETE=5 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Flow 'volume_create_manager' (47046748-851b-4ca5-add0-81c2c2504713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61aaf15b-9817-4386-adea-ed2244ce3f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61aaf15b-9817-4386-adea-ed2244ce3f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-543996200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5941f1-fead-4da0-a922-ada70f90a665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725cb756cac143fd8b5e8556b5127fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:15Z,use_quota=True,user_id='cc942b3ed60e49beb5ad54b4238bfef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28748d70-e734-4d7d-a583-95e82bb66ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28748d70-e734-4d7d-a583-95e82bb66ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3158a75-09c7-400c-8cf9-ce7948429b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3158a75-09c7-400c-8cf9-ce7948429b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5941f1-fead-4da0-a922-ada70f90a665', 'volume_name': 'volume-ef5941f1-fead-4da0-a922-ada70f90a665', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46defd8b-0d3e-4179-8b02-492896efe9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46defd8b-0d3e-4179-8b02-492896efe9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16851fb-a235-49b9-8c40-137f15ef29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:14 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Volume ef5941f1-fead-4da0-a922-ada70f90a665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5941f1-fead-4da0-a922-ada70f90a665', 'volume_size': 1} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-543996200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5941f1-fead-4da0-a922-ada70f90a665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725cb756cac143fd8b5e8556b5127fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:15Z,use_quota=True,user_id='cc942b3ed60e49beb5ad54b4238bfef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Creating volume ef5941f1-fead-4da0-a922-ada70f90a665 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:19:14 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:19:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:14 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 1073741824 Apr 29 18:19:14 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:15 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 1073741824" returned: 0 in 0.741s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:15 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 Apr 29 18:19:15 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:16 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665" returned: 0 in 0.570s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16851fb-a235-49b9-8c40-137f15ef29fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5941f1-fead-4da0-a922-ada70f90a665', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc576e59-02de-4838-861e-7dcb675bbcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:16 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Volume volume-ef5941f1-fead-4da0-a922-ada70f90a665 (ef5941f1-fead-4da0-a922-ada70f90a665): created successfully Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc576e59-02de-4838-861e-7dcb675bbcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Flow 'volume_create_manager' (47046748-851b-4ca5-add0-81c2c2504713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-40a27918-39a0-4358-9df9-bc0b9e457858 tempest-VolumesTransfersV357Test-1792711023 None] Created volume successfully. Apr 29 18:19:17 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-3b8527a3-03f5-46b6-a0d2-c138fc3194dd tempest-VolumesTransfersV357Test-1808548696 None] Transfer volume completed successfully. Apr 29 18:19:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Acquiring lock "cinder-ef5941f1-fead-4da0-a922-ada70f90a665-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-ef5941f1-fead-4da0-a922-ada70f90a665-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Acquiring lock "cinder-quobyte-ef5941f1-fead-4da0-a922-ada70f90a665" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-quobyte-ef5941f1-fead-4da0-a922-ada70f90a665" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:18 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1526d0f-8e5c-4774-8304-c10b3586dbd0]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:19:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:18 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 Apr 29 18:19:18 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:19 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665" returned: 0 in 0.674s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:19 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665 Apr 29 18:19:19 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:19 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ef5941f1-fead-4da0-a922-ada70f90a665" returned: 0 in 0.568s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-quobyte-ef5941f1-fead-4da0-a922-ada70f90a665" released by "delete_volume" :: held 1.278s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Created reservations ['3eae4c86-c528-4efa-b217-98bd336a0089', '43a9551c-07c5-44fa-a645-bbb54baa880a', '06596576-fa5b-44e5-bdd4-7e16d4d8f877', 'cec70ca6-6cc0-44f9-84f4-d49e18001bfc'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:19 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:19:19 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:20 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.561s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:19:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Deleted volume successfully. Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d733f8-9b3d-4fbf-a8fc-2188b9d30375 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-ef5941f1-fead-4da0-a922-ada70f90a665-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Flow 'volume_create_manager' (4008a351-3e9d-4ef2-b75c-8c7cf6fd3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da3cd02-99f9-40ab-beb4-69e970332aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da3cd02-99f9-40ab-beb4-69e970332aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-741887851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6486c839-ee48-466e-8753-7f62a4448af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725cb756cac143fd8b5e8556b5127fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:21Z,use_quota=True,user_id='cc942b3ed60e49beb5ad54b4238bfef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b669a0a-ce32-4c43-9968-55b03b7bdd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b669a0a-ce32-4c43-9968-55b03b7bdd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aee287-e405-4759-a876-816dd7ce678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aee287-e405-4759-a876-816dd7ce678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6486c839-ee48-466e-8753-7f62a4448af9', 'volume_name': 'volume-6486c839-ee48-466e-8753-7f62a4448af9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc855fe-ac5a-4565-b212-67b6fd35e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc855fe-ac5a-4565-b212-67b6fd35e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6ca1c6-0e61-439d-9cd9-9f2250c3c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:20 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Volume 6486c839-ee48-466e-8753-7f62a4448af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6486c839-ee48-466e-8753-7f62a4448af9', 'volume_size': 1} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-741887851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6486c839-ee48-466e-8753-7f62a4448af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725cb756cac143fd8b5e8556b5127fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:21Z,use_quota=True,user_id='cc942b3ed60e49beb5ad54b4238bfef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Creating volume 6486c839-ee48-466e-8753-7f62a4448af9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:19:20 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:19:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:20 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 1073741824 Apr 29 18:19:20 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:21 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 1073741824" returned: 0 in 0.748s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:21 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 Apr 29 18:19:21 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:22 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9" returned: 0 in 0.585s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6ca1c6-0e61-439d-9cd9-9f2250c3c44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6486c839-ee48-466e-8753-7f62a4448af9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81e50ba-cc1b-4f3a-b368-da2fddd6452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:22 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Volume volume-6486c839-ee48-466e-8753-7f62a4448af9 (6486c839-ee48-466e-8753-7f62a4448af9): created successfully Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81e50ba-cc1b-4f3a-b368-da2fddd6452f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:22 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Flow 'volume_create_manager' (4008a351-3e9d-4ef2-b75c-8c7cf6fd3985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:22 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bdb7cec8-dd67-45a5-a6ec-afcd1046a8b8 tempest-VolumesTransfersV357Test-1792711023 None] Created volume successfully. Apr 29 18:19:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Acquiring lock "cinder-6486c839-ee48-466e-8753-7f62a4448af9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-6486c839-ee48-466e-8753-7f62a4448af9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Acquiring lock "cinder-quobyte-6486c839-ee48-466e-8753-7f62a4448af9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-quobyte-6486c839-ee48-466e-8753-7f62a4448af9" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9482ea7-a6da-4e33-b0df-e590aec629a1]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:19:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:23 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 Apr 29 18:19:23 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:24 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9" returned: 0 in 0.680s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:24 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9 Apr 29 18:19:24 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:24 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6486c839-ee48-466e-8753-7f62a4448af9" returned: 0 in 0.567s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-quobyte-6486c839-ee48-466e-8753-7f62a4448af9" released by "delete_volume" :: held 1.281s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Created reservations ['31ee52f6-e8d3-497c-9d7a-5469e19f826d', '7c2708c7-62c4-4f0b-9a08-d578574e7fef', 'e547d9df-ed55-4378-b45d-2e15a86fb792', '840d77d7-87b8-43a2-8709-8714466e1069'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:24 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:19:24 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:25 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.570s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:25 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:19:25 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Deleted volume successfully. Apr 29 18:19:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-76b0c68e-ae72-4baf-8bed-b2feab028894 tempest-VolumesTransfersV357Test-1320821266 None] Lock "cinder-6486c839-ee48-466e-8753-7f62a4448af9-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:34 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=11,cinder:UPDATE=22,cinder:INSERT=5 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=67,cinder:SELECT=45,cinder:INSERT=16,cinder:DELETE=9 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:35 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:19:35 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:36 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.607s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Flow 'volume_create_manager' (b5b17bfa-5d31-45f6-95c3-e121491c1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a43d00-16be-4f3b-b169-2a735f73bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a43d00-16be-4f3b-b169-2a735f73bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071344967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7f3b77-cabe-4ee7-a819-7a8be41509e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093310f28f4449698d6761f587aba77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:40Z,use_quota=True,user_id='dd04f9c617bd4ebd910a1890c32e43d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67ca302-b3f0-48c1-9ee8-e3346f14ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67ca302-b3f0-48c1-9ee8-e3346f14ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b39488d-2dbb-45c0-b852-d00882d83110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b39488d-2dbb-45c0-b852-d00882d83110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7f3b77-cabe-4ee7-a819-7a8be41509e2', 'volume_name': 'volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effd6b30-313b-41bb-bf0d-27c9cc815bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effd6b30-313b-41bb-bf0d-27c9cc815bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9050b0bb-2f89-4b80-bf87-3a8b1969dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:39 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Volume db7f3b77-cabe-4ee7-a819-7a8be41509e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2', 'volume_size': 1} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071344967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7f3b77-cabe-4ee7-a819-7a8be41509e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093310f28f4449698d6761f587aba77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:19:40Z,use_quota=True,user_id='dd04f9c617bd4ebd910a1890c32e43d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Creating volume db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:19:39 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:19:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:39 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 1073741824 Apr 29 18:19:39 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:40 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 1073741824" returned: 0 in 0.730s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:19:40 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:19:40 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:19:41 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.594s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9050b0bb-2f89-4b80-bf87-3a8b1969dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195d64c8-04d8-4b5a-aa01-a40dec4d1683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:19:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Volume volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 (db7f3b77-cabe-4ee7-a819-7a8be41509e2): created successfully Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195d64c8-04d8-4b5a-aa01-a40dec4d1683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:19:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Flow 'volume_create_manager' (b5b17bfa-5d31-45f6-95c3-e121491c1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:19:41 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-357817a0-e309-4e66-8193-1116ab9ca1f5 tempest-VolumesActionsTest-775987165 None] Created volume successfully. Apr 29 18:19:51 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:19:51 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:19:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d009940f-a28d-41a3-b1d4-a9f3fb0a2550 tempest-VolumesActionsTest-775987165 None] Acquiring lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2" by "attach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d009940f-a28d-41a3-b1d4-a9f3fb0a2550 tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2" acquired by "attach_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d009940f-a28d-41a3-b1d4-a9f3fb0a2550 tempest-VolumesActionsTest-775987165 None] Attaching volume db7f3b77-cabe-4ee7-a819-7a8be41509e2 to instance 94c88cdc-1336-4c17-9513-a8e675afb4e2 at mountpoint /dev/vdb on host None. Apr 29 18:19:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d009940f-a28d-41a3-b1d4-a9f3fb0a2550 tempest-VolumesActionsTest-775987165 None] Attach volume completed successfully. Apr 29 18:19:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d009940f-a28d-41a3-b1d4-a9f3fb0a2550 tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2" released by "attach_volume" :: held 0.092s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:19:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c4aa0ab1-a8a2-4511-8043-5f1c016dad7d tempest-VolumesActionsTest-775987165 None] Acquiring lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-detach_volume" by "detach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:19:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c4aa0ab1-a8a2-4511-8043-5f1c016dad7d tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:19:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c4aa0ab1-a8a2-4511-8043-5f1c016dad7d tempest-VolumesActionsTest-775987165 None] Detaching volume db7f3b77-cabe-4ee7-a819-7a8be41509e2 from instance 94c88cdc-1336-4c17-9513-a8e675afb4e2. Apr 29 18:19:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c4aa0ab1-a8a2-4511-8043-5f1c016dad7d tempest-VolumesActionsTest-775987165 None] Detach volume completed successfully. Apr 29 18:19:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c4aa0ab1-a8a2-4511-8043-5f1c016dad7d tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:20:07 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:INSERT=2,cinder:SELECT=5,cinder:UPDATE=3 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:20:07 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:20:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d0199b35-9a1b-40d5-a5c6-5358eac097bb tempest-VolumesActionsTest-775987165 None] Acquiring lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2" by "attach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:20:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d0199b35-9a1b-40d5-a5c6-5358eac097bb tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2" acquired by "attach_volume" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:20:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d0199b35-9a1b-40d5-a5c6-5358eac097bb tempest-VolumesActionsTest-775987165 None] Attaching volume db7f3b77-cabe-4ee7-a819-7a8be41509e2 to instance 3f8da67a-d990-4f66-b061-7927131804ed at mountpoint /dev/vdb on host None. Apr 29 18:20:19 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d0199b35-9a1b-40d5-a5c6-5358eac097bb tempest-VolumesActionsTest-775987165 None] Attach volume completed successfully. Apr 29 18:20:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d0199b35-9a1b-40d5-a5c6-5358eac097bb tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2" released by "attach_volume" :: held 0.081s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:20:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d7ace9a2-e9b2-4b27-8a5c-b8d9a65353a0 tempest-VolumesActionsTest-775987165 None] Acquiring lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-detach_volume" by "detach_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:20:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d7ace9a2-e9b2-4b27-8a5c-b8d9a65353a0 tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:20:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d7ace9a2-e9b2-4b27-8a5c-b8d9a65353a0 tempest-VolumesActionsTest-775987165 None] Detaching volume db7f3b77-cabe-4ee7-a819-7a8be41509e2 from instance 3f8da67a-d990-4f66-b061-7927131804ed. Apr 29 18:20:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d7ace9a2-e9b2-4b27-8a5c-b8d9a65353a0 tempest-VolumesActionsTest-775987165 None] Detach volume completed successfully. Apr 29 18:20:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d7ace9a2-e9b2-4b27-8a5c-b8d9a65353a0 tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:20:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:20:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:20:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[181e3b31-e7b1-4b2f-8728-59399b1bf716]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:20:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:28 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:20:28 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:29 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:29 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2f85c-1160-42dd-b694-78b44e9707de]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:20:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:29 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:20:29 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:30 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.667s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.333e2491-e132-4767-808c-860833f896d1438xy3cy.img {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:30 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.333e2491-e132-4767-808c-860833f896d1438xy3cy.img Apr 29 18:20:30 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:30 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:20:34 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.333e2491-e132-4767-808c-860833f896d1438xy3cy.img" returned: 0 in 4.026s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:34 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c2acad-2451-4c9b-ab7f-b700d0495b02]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:20:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:34 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:20:34 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:35 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.862s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.333e2491-e132-4767-808c-860833f896d1438xy3cy.img {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:20:35 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Converted 1024.00 MB image at 254.28 MB/s Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] 333e2491-e132-4767-808c-860833f896d1 was raw, no need to convert to raw {{(pid=84402) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:20:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:35 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:20:35 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:36 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:20:45 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=1 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:20:45 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:20:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.495s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:20:53 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Uploaded volume to glance image-id: 333e2491-e132-4767-808c-860833f896d1. {{(pid=84402) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 18:20:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8253ad57-f8fd-412d-91d4-b8460517fec3 tempest-VolumesActionsTest-775987165 None] Copy volume to image completed successfully. Apr 29 18:20:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:20:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:20:54 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[56072657-f336-422b-8bb4-ce4658ea6a12]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:20:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:54 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:20:54 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:55 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.684s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:55 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1bb801-855c-4a7c-bcea-33dd19d7b58a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:20:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:55 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:20:55 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:55 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.689s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:55 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img Apr 29 18:20:55 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:20:59 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Apr 29 18:20:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img" returned: 0 in 4.036s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:20:59 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[26955943-edc3-421e-bf34-8c64d063bf9b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:20:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:20:59 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:20:59 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:00 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.816s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:00 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:21:00 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Converted 1024.00 MB image at 253.58 MB/s Apr 29 18:21:00 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] ee48f2f3-bf84-46f6-a646-30750d23fa56 was raw, converting to qcow2 {{(pid=84402) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 18:21:00 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b3554-df6c-435a-b473-0b14232aeb01]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:00 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img Apr 29 18:21:00 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:01 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img" returned: 0 in 0.630s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:01 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img Apr 29 18:21:01 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:01 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img" returned: 1 in 0.631s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:21:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:01 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5 Apr 29 18:21:01 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:02 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5" returned: 0 in 0.565s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:02 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Image conversion details: src /opt/stack/data/cinder/conversion/db7f3b77-cabe-4ee7-a819-7a8be41509e2.temp_image.ee48f2f3-bf84-46f6-a646-30750d23fa567dw09xt9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5 {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:21:02 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 18:21:02 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[04797933-2dda-4c6e-9416-7ea61fcdc37e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:02 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5 Apr 29 18:21:02 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:03 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m5e6ugl5" returned: 0 in 0.637s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.873s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Uploaded volume to glance image-id: ee48f2f3-bf84-46f6-a646-30750d23fa56. {{(pid=84402) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 18:21:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bf825d24-32e2-4386-8bba-183cb6f77efd tempest-VolumesActionsTest-775987165 None] Copy volume to image completed successfully. Apr 29 18:21:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Acquiring lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Acquiring lock "cinder-quobyte-db7f3b77-cabe-4ee7-a819-7a8be41509e2" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Lock "cinder-quobyte-db7f3b77-cabe-4ee7-a819-7a8be41509e2" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:05 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aee05e-92d9-4c87-8c3d-64d0b74c06d5]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:05 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:21:05 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:06 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:06 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2 Apr 29 18:21:06 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:06 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-db7f3b77-cabe-4ee7-a819-7a8be41509e2" returned: 0 in 0.552s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Lock "cinder-quobyte-db7f3b77-cabe-4ee7-a819-7a8be41509e2" released by "delete_volume" :: held 1.235s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Created reservations ['93a63691-d805-449e-92ef-bf4c12da03d0', 'c904c82f-df6b-49f7-a7a9-8ef52255ec84', '34ba8cf7-15db-4530-b74d-ccd3d65d1701', '413a824f-da7c-4230-b6c7-5890c8c80801'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:06 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:06 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:07 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.557s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:07 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:07 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Deleted volume successfully. Apr 29 18:21:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-871739dd-622a-45a0-9c15-f1f717764f87 tempest-VolumesActionsTest-775987165 None] Lock "cinder-db7f3b77-cabe-4ee7-a819-7a8be41509e2-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Flow 'volume_create_manager' (3e8b8281-c9cc-4ed4-9524-0a802443c2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e25e1ca-a499-4945-a8c0-aafa142230e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e25e1ca-a499-4945-a8c0-aafa142230e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-459476147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f5ed3f-9efa-40f1-89f7-34a1ce0b340d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9532647db6a44a3b90a0dee6a82096cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:13Z,use_quota=True,user_id='230d2a23bada4d35bc6f8e0d9eff510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d847977-582d-40c4-965a-8bb2b96f40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d847977-582d-40c4-965a-8bb2b96f40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc14f8bf-e014-4bcb-86b8-0a5fe2474f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.image.glance [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Creating Keystone auth plugin from conf {{(pid=84402) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc14f8bf-e014-4bcb-86b8-0a5fe2474f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03f5ed3f-9efa-40f1-89f7-34a1ce0b340d', 'volume_name': 'volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31b60b8-ca78-4caa-8fbd-5a2b565a5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31b60b8-ca78-4caa-8fbd-5a2b565a5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18abda63-f5b9-4a92-b6f5-d8d5a254f152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:12 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Volume 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 18:21:12 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Trying to clone 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]). {{(pid=84402) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 18:21:13 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Image download 20.69 MB at 20.69 MB/s Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e86f4a-ba15-40b8-a13e-c9d8a25244e6]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:13 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD Apr 29 18:21:13 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:13 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD" returned: 0 in 0.640s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 is fetched for user 230d2a23bada4d35bc6f8e0d9eff510c. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[173c9672-b070-4f15-aac3-7e1404a3141e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:14 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD Apr 29 18:21:14 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:14 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD" returned: 0 in 0.643s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-459476147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f5ed3f-9efa-40f1-89f7-34a1ce0b340d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9532647db6a44a3b90a0dee6a82096cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:13Z,use_quota=True,user_id='230d2a23bada4d35bc6f8e0d9eff510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Creating volume 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:21:14 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:21:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:14 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 1073741824 Apr 29 18:21:14 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:15 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 1073741824" returned: 0 in 0.719s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:15 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:15 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:15 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 0 in 0.559s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:21:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:15 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Attempting download of 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 18:21:16 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5957a5-0a4c-45be-b6b0-824de7849404]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:16 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy Apr 29 18:21:16 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:16 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy" returned: 0 in 0.626s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:16 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy Apr 29 18:21:16 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:17 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy" returned: 1 in 0.650s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_orhicluy' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a92fa2-465f-4275-85a3-cf596b5a14ca]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:17 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD Apr 29 18:21:17 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:17 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 was qcow2, converting to raw {{(pid=84402) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 18:21:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:17 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:17 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:19 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 0 in 1.616s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:19 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ebc34ce-c995-4204-8b3b-09ad4bff96c5_dxbw89xydevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:21:19 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Converted 112.00 MB image at 69.26 MB/s Apr 29 18:21:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:19 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 1G Apr 29 18:21:19 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:20 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 1G" returned: 0 in 0.599s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b480e1-4467-41cf-ac00-a5ec885decbc]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:20 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:20 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:20 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 0 in 0.692s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:20 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:20 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:21 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 1 in 0.686s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Downloaded image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}])) to volume 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d successfully. {{(pid=84402) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Temporary image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 for user 230d2a23bada4d35bc6f8e0d9eff510c is deleted. {{(pid=84402) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.volume_utils [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Marking volume 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d as bootable. {{(pid=84402) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Copying metadata from image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 to 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d. {{(pid=84402) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Creating volume glance metadata for volume 03f5ed3f-9efa-40f1-89f7-34a1ce0b340d backed by image 6ebc34ce-c995-4204-8b3b-09ad4bff96c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84402) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18abda63-f5b9-4a92-b6f5-d8d5a254f152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d', 'volume_size': 1, 'image_id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1605f8cad449455b8789213b7e4da32c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ebc34ce-c995-4204-8b3b-09ad4bff96c5', 'created_at': datetime.datetime(2026, 4, 29, 16, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ebc34ce-c995-4204-8b3b-09ad4bff96c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d362a6eb-61d3-49e9-bfcf-a2e57ee58f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:21 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Volume volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d (03f5ed3f-9efa-40f1-89f7-34a1ce0b340d): created successfully Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d362a6eb-61d3-49e9-bfcf-a2e57ee58f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:21 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Flow 'volume_create_manager' (3e8b8281-c9cc-4ed4-9524-0a802443c2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:21 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-aed6b6ce-74cc-4680-b3a0-ae4cc86e86f0 tempest-VolumesExtendTest-692248334 None] Created volume successfully. Apr 29 18:21:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:22 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a1489-fc44-413c-b9fd-6d9fa6e38508]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:22 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:22 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:22 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 0 in 0.684s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:23 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:23 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:23 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 1 in 0.702s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:21:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 2G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d 2G" returned: 0 in 0.056s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.484s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:23 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-877cd957-935e-477d-ab10-ff830e9670e8 tempest-VolumesExtendTest-692248334 None] Extend volume completed successfully. Apr 29 18:21:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Lock "cinder-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-quobyte-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:24 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2234907-4e4a-4e51-a9e0-a43582cc2ad0]: (4, 'raw') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:24 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:24 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:25 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 0 in 0.659s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:25 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:25 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:25 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 1 in 0.654s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d' failed. Not Retrying. {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:21:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:26 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d Apr 29 18:21:26 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:26 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" returned: 0 in 0.554s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d" released by "delete_volume" :: held 1.925s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Created reservations ['7c06e105-eafe-401c-be24-f4ba90814120', '0a58eaa3-04d7-4221-9877-2f950cb0d312', '827d1095-5c32-4826-9f3b-4ea293c4cae0', '8d632bfa-3c3a-4b7f-a959-52e1a4d6e077'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:26 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:26 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Flow 'volume_create_manager' (98f3508c-5d73-4ff9-81de-eaeab8e610c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c476fd5-a203-4e2d-a5e4-2d9da617ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c476fd5-a203-4e2d-a5e4-2d9da617ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1832371091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b5afe3-b7ab-4a5c-8886-b478734586db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9532647db6a44a3b90a0dee6a82096cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:27Z,use_quota=True,user_id='230d2a23bada4d35bc6f8e0d9eff510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458a6762-ed4d-4818-b932-48fffe857fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458a6762-ed4d-4818-b932-48fffe857fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ea4069-92f2-40da-9cfb-e5cfd48c5870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ea4069-92f2-40da-9cfb-e5cfd48c5870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b5afe3-b7ab-4a5c-8886-b478734586db', 'volume_name': 'volume-31b5afe3-b7ab-4a5c-8886-b478734586db', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621bdd62-c411-46da-92ce-eb851161abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621bdd62-c411-46da-92ce-eb851161abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047a0e9-98a0-42f3-83db-a3027a01e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:27 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Volume 31b5afe3-b7ab-4a5c-8886-b478734586db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b5afe3-b7ab-4a5c-8886-b478734586db', 'volume_size': 1} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1832371091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b5afe3-b7ab-4a5c-8886-b478734586db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9532647db6a44a3b90a0dee6a82096cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:27Z,use_quota=True,user_id='230d2a23bada4d35bc6f8e0d9eff510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Creating volume 31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:21:27 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:27 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db 1073741824 Apr 29 18:21:27 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:27 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.583s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:27 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Deleted volume successfully. Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-32c594cf-a7c7-437c-9e98-bb1cc565c9e3 tempest-VolumesExtendTest-692248334 None] Lock "cinder-03f5ed3f-9efa-40f1-89f7-34a1ce0b340d-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:27 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db 1073741824" returned: 0 in 0.714s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:28 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db Apr 29 18:21:28 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:28 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db" returned: 0 in 0.563s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047a0e9-98a0-42f3-83db-a3027a01e280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b5afe3-b7ab-4a5c-8886-b478734586db', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1210d6-b4b2-44f1-86c4-0d5cbd79551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Volume volume-31b5afe3-b7ab-4a5c-8886-b478734586db (31b5afe3-b7ab-4a5c-8886-b478734586db): created successfully Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1210d6-b4b2-44f1-86c4-0d5cbd79551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Flow 'volume_create_manager' (98f3508c-5d73-4ff9-81de-eaeab8e610c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:28 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e6580d1d-baee-4dd7-9d02-49d9bfa07d03 tempest-VolumesExtendTest-692248334 None] Created volume successfully. Apr 29 18:21:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:29 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Creating offline snapshot 58d01676-51e6-43b3-90f3-3c47fe35a871 of volume 31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:21:29 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaba004-1b67-4103-b9e0-b5ea9c2fea80]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:29 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db Apr 29 18:21:29 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:30 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db" returned: 0 in 0.703s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:30 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 1G Apr 29 18:21:30 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:30 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 1G" returned: 0 in 0.706s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b5afe3-b7ab-4a5c-8886-b478734586db -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:30 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b5afe3-b7ab-4a5c-8886-b478734586db -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 Apr 29 18:21:30 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:31 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b5afe3-b7ab-4a5c-8886-b478734586db -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871" returned: 0 in 0.597s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:31 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 is being set with open permissions: ugo+rw Apr 29 18:21:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:31 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 Apr 29 18:21:31 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:32 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871" returned: 0 in 0.567s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:32 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info Apr 29 18:21:32 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:32 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info" returned: 0 in 0.582s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:32 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info is being set with open permissions: ugo+rw Apr 29 18:21:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:32 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info Apr 29 18:21:32 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:33 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.info" returned: 0 in 0.562s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.802s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b20ff71c-0c8a-4c3a-971e-90bdd3a78f1c tempest-VolumesExtendTest-692248334 None] Create snapshot completed successfully Apr 29 18:21:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:33 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dffc97-2e87-4768-85d3-cabe58f738c3]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:33 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db Apr 29 18:21:33 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:34 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db" returned: 0 in 0.665s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 2G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 2G" returned: 0 in 0.110s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.804s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:34 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a64d0b32-2d18-4dbe-970a-adbfd97130cf tempest-VolumesExtendTest-692248334 None] Extend volume completed successfully. Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-58d01676-51e6-43b3-90f3-3c47fe35a871-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Lock "cinder-58d01676-51e6-43b3-90f3-3c47fe35a871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-quobyte-31b5afe3-b7ab-4a5c-8886-b478734586db" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-31b5afe3-b7ab-4a5c-8886-b478734586db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-quobyte-58d01676-51e6-43b3-90f3-3c47fe35a871" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-58d01676-51e6-43b3-90f3-3c47fe35a871" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Deleting offline snapshot 58d01676-51e6-43b3-90f3-3c47fe35a871 of volume 31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] snapshot_file for this snap is: volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa0cdc-a82a-4cd1-91b4-f89be230d7dd]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:35 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 Apr 29 18:21:35 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:35 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871" returned: 0 in 0.668s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b5afe3-b7ab-4a5c-8886-b478734586db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[26208d2a-8167-4f82-a424-2a88574dd005]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:35 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db Apr 29 18:21:35 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:35 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:35 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:36 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:36 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 Apr 29 18:21:36 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:36 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.575s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:36 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:37 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871 Apr 29 18:21:37 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:37 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db.58d01676-51e6-43b3-90f3-3c47fe35a871" returned: 0 in 0.544s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-58d01676-51e6-43b3-90f3-3c47fe35a871" released by "_delete_snapshot" :: held 2.667s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-31b5afe3-b7ab-4a5c-8886-b478734586db" released by "delete_snapshot" :: held 2.687s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Created reservations ['5040b525-b581-4fda-8eb7-2378a8e44565', '28dcbbc4-8e39-4d82-a17f-9131034e4366', '52c870f2-12af-4bc8-9636-cebc99b30c02', 'af78d4e2-5576-4767-81b9-dcec4c083828'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:37 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Delete snapshot completed successfully. Apr 29 18:21:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d2206d78-e069-43a7-a8d6-88ad35b7c178 tempest-VolumesExtendTest-692248334 None] Lock "cinder-58d01676-51e6-43b3-90f3-3c47fe35a871-delete_snapshot" released by "delete_snapshot" :: held 2.815s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-31b5afe3-b7ab-4a5c-8886-b478734586db-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Lock "cinder-31b5afe3-b7ab-4a5c-8886-b478734586db-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Acquiring lock "cinder-quobyte-31b5afe3-b7ab-4a5c-8886-b478734586db" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-31b5afe3-b7ab-4a5c-8886-b478734586db" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb028b0-bb06-402f-90cd-3302c48258d2]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:38 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db Apr 29 18:21:38 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:38 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db" returned: 0 in 0.657s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:38 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db Apr 29 18:21:38 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:39 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-31b5afe3-b7ab-4a5c-8886-b478734586db" returned: 0 in 0.546s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Lock "cinder-quobyte-31b5afe3-b7ab-4a5c-8886-b478734586db" released by "delete_volume" :: held 1.259s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Created reservations ['8e4f4213-27d8-4107-bd80-13a654f36878', 'f3201894-0cf6-44d8-b83a-1320db2125d5', '73447aa4-395a-40ef-8069-df42bccfdf92', '4b0ea992-344a-4f6a-a9c4-b17fdfdebb11'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:39 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:39 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:40 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.555s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:40 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:40 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Deleted volume successfully. Apr 29 18:21:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fab568f2-4438-404a-9ec9-9058e32a80cf tempest-VolumesExtendTest-692248334 None] Lock "cinder-31b5afe3-b7ab-4a5c-8886-b478734586db-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Flow 'volume_create_manager' (f757c2ab-3a28-4a1e-b10e-2aeaac07a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4de2bf9-00e1-44ed-85ef-7d4ddb738eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4de2bf9-00e1-44ed-85ef-7d4ddb738eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1223708863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32c8dcffdf3e45abbee0d38cd1038ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:43Z,use_quota=True,user_id='5cae639ccd04459ba032c3bbb69eff1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82799cf3-ede7-489a-a32d-bc44a97244aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82799cf3-ede7-489a-a32d-bc44a97244aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f288b2-5615-4bbb-b1ec-8b7686c9e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f288b2-5615-4bbb-b1ec-8b7686c9e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4', 'volume_name': 'volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b44176f-2ce7-4861-98d1-a4c5616a5c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b44176f-2ce7-4861-98d1-a4c5616a5c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d367d9-2047-406b-a35a-ce719bef3b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Volume 6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4', 'volume_size': 1} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1223708863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32c8dcffdf3e45abbee0d38cd1038ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:43Z,use_quota=True,user_id='5cae639ccd04459ba032c3bbb69eff1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Creating volume 6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:21:42 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:21:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:42 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 1073741824 Apr 29 18:21:42 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:43 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 1073741824" returned: 0 in 0.712s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:43 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 Apr 29 18:21:43 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:44 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4" returned: 0 in 0.557s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d367d9-2047-406b-a35a-ce719bef3b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4ae057-ad56-4a26-8921-f50ccfb20105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:44 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Volume volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 (6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4): created successfully Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4ae057-ad56-4a26-8921-f50ccfb20105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Flow 'volume_create_manager' (f757c2ab-3a28-4a1e-b10e-2aeaac07a37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f47801f7-471c-4bf4-9889-095ab1613d59 tempest-VolumesListTestJSON-877008844 None] Created volume successfully. Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=50,cinder:SELECT=44,cinder:INSERT=13,cinder:DELETE=2 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=44,cinder:UPDATE=47,cinder:INSERT=20,cinder:DELETE=5 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Flow 'volume_create_manager' (503e5c86-7cd9-4fc6-9525-e34b7b2b227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64efa1-c851-4dac-b90d-e73900a8899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64efa1-c851-4dac-b90d-e73900a8899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-941117151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49591f2d-acb1-4b2a-acf9-54adede7d118,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32c8dcffdf3e45abbee0d38cd1038ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:45Z,use_quota=True,user_id='5cae639ccd04459ba032c3bbb69eff1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc5e1ee-2908-45c9-b51f-e59e25211bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc5e1ee-2908-45c9-b51f-e59e25211bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4416b2f-152d-488c-9170-3c8d3e0c3d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4416b2f-152d-488c-9170-3c8d3e0c3d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49591f2d-acb1-4b2a-acf9-54adede7d118', 'volume_name': 'volume-49591f2d-acb1-4b2a-acf9-54adede7d118', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6074ab29-a4a9-4d73-9880-e4d00be3483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6074ab29-a4a9-4d73-9880-e4d00be3483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34ba040-ecb8-4e20-ab3c-a3c2adac1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:45 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Volume 49591f2d-acb1-4b2a-acf9-54adede7d118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49591f2d-acb1-4b2a-acf9-54adede7d118', 'volume_size': 1} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-941117151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49591f2d-acb1-4b2a-acf9-54adede7d118,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32c8dcffdf3e45abbee0d38cd1038ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:45Z,use_quota=True,user_id='5cae639ccd04459ba032c3bbb69eff1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Creating volume 49591f2d-acb1-4b2a-acf9-54adede7d118 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:21:45 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:21:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:45 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 1073741824 Apr 29 18:21:45 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:46 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 1073741824" returned: 0 in 0.712s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:46 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 Apr 29 18:21:46 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:46 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118" returned: 0 in 0.579s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34ba040-ecb8-4e20-ab3c-a3c2adac1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49591f2d-acb1-4b2a-acf9-54adede7d118', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c04a72-7875-44f8-b374-6195bd885e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Volume volume-49591f2d-acb1-4b2a-acf9-54adede7d118 (49591f2d-acb1-4b2a-acf9-54adede7d118): created successfully Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c04a72-7875-44f8-b374-6195bd885e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Flow 'volume_create_manager' (503e5c86-7cd9-4fc6-9525-e34b7b2b227c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b2fb37c5-8adf-4475-b702-935e9df238f1 tempest-VolumesListTestJSON-877008844 None] Created volume successfully. Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Flow 'volume_create_manager' (56eb2273-5c5f-447f-a977-7a6fd5a2d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e821be-56cc-45ba-a5f1-26df4ff35108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e821be-56cc-45ba-a5f1-26df4ff35108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-217192833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc7de69-e84f-4779-a4d9-75e375efced8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32c8dcffdf3e45abbee0d38cd1038ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:48Z,use_quota=True,user_id='5cae639ccd04459ba032c3bbb69eff1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe89a622-0692-432c-9873-89d0e51193ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe89a622-0692-432c-9873-89d0e51193ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92c26d7-27bd-4895-83f1-040f864059db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92c26d7-27bd-4895-83f1-040f864059db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc7de69-e84f-4779-a4d9-75e375efced8', 'volume_name': 'volume-1bc7de69-e84f-4779-a4d9-75e375efced8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8932def2-8c9e-4958-b839-fd209a6512fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8932def2-8c9e-4958-b839-fd209a6512fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1d4330-3098-4fe3-907a-7c435c1583c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Volume 1bc7de69-e84f-4779-a4d9-75e375efced8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc7de69-e84f-4779-a4d9-75e375efced8', 'volume_size': 1} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-217192833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc7de69-e84f-4779-a4d9-75e375efced8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32c8dcffdf3e45abbee0d38cd1038ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:21:48Z,use_quota=True,user_id='5cae639ccd04459ba032c3bbb69eff1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Creating volume 1bc7de69-e84f-4779-a4d9-75e375efced8 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:21:48 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:48 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 1073741824 Apr 29 18:21:48 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:48 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 1073741824" returned: 0 in 0.777s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:48 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 Apr 29 18:21:48 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:49 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8" returned: 0 in 0.560s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1d4330-3098-4fe3-907a-7c435c1583c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc7de69-e84f-4779-a4d9-75e375efced8', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e295861-b2c3-437f-8781-ba563c0ee753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:21:49 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Volume volume-1bc7de69-e84f-4779-a4d9-75e375efced8 (1bc7de69-e84f-4779-a4d9-75e375efced8): created successfully Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e295861-b2c3-437f-8781-ba563c0ee753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:21:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Flow 'volume_create_manager' (56eb2273-5c5f-447f-a977-7a6fd5a2d41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:21:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a9dbf604-4bda-4ed1-95fa-bd87a1a165d9 tempest-VolumesListTestJSON-877008844 None] Created volume successfully. Apr 29 18:21:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Acquiring lock "cinder-1bc7de69-e84f-4779-a4d9-75e375efced8-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Lock "cinder-1bc7de69-e84f-4779-a4d9-75e375efced8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Acquiring lock "cinder-quobyte-1bc7de69-e84f-4779-a4d9-75e375efced8" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Lock "cinder-quobyte-1bc7de69-e84f-4779-a4d9-75e375efced8" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[c216341c-76fb-4f87-aad7-27fdd176ee06]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:51 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 Apr 29 18:21:51 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:52 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8" returned: 0 in 0.671s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:52 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8 Apr 29 18:21:52 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:53 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-1bc7de69-e84f-4779-a4d9-75e375efced8" returned: 0 in 0.564s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Lock "cinder-quobyte-1bc7de69-e84f-4779-a4d9-75e375efced8" released by "delete_volume" :: held 1.271s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Created reservations ['da0a05b3-21a8-4643-a5c8-4b66f170822f', 'd8595bd3-24c3-4b86-b845-65fc3ccc12d6', 'c6009b3d-9538-4fde-aea1-9f7db2a4266b', '01f39ca1-c1e4-48d0-9153-5d44337bed10'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:53 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:53 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:53 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.580s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:53 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Deleted volume successfully. Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-80a47d06-4431-44d4-a375-f0934fd87a9b tempest-VolumesListTestJSON-877008844 None] Lock "cinder-1bc7de69-e84f-4779-a4d9-75e375efced8-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Acquiring lock "cinder-49591f2d-acb1-4b2a-acf9-54adede7d118-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Lock "cinder-49591f2d-acb1-4b2a-acf9-54adede7d118-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Acquiring lock "cinder-quobyte-49591f2d-acb1-4b2a-acf9-54adede7d118" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Lock "cinder-quobyte-49591f2d-acb1-4b2a-acf9-54adede7d118" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:54 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c60a249-8602-4300-bc54-9946847eda1b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:54 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 Apr 29 18:21:54 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:54 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118" returned: 0 in 0.707s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:54 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118 Apr 29 18:21:54 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:55 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-49591f2d-acb1-4b2a-acf9-54adede7d118" returned: 0 in 0.620s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Lock "cinder-quobyte-49591f2d-acb1-4b2a-acf9-54adede7d118" released by "delete_volume" :: held 1.366s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Created reservations ['bc79c0f9-466c-4def-ba46-5c82e958985e', '7d35d402-dfd0-46fe-9ab1-2e1dfd87e2e8', '4735c0a4-d01d-48f9-bc54-2cddd86e00f1', 'e560ee95-b874-4c87-b75f-4ea6ca084d36'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:55 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:55 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:56 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.565s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:56 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Deleted volume successfully. Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a168860e-2a1e-4992-9f17-c4e6acd8e2bf tempest-VolumesListTestJSON-877008844 None] Lock "cinder-49591f2d-acb1-4b2a-acf9-54adede7d118-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Acquiring lock "cinder-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Lock "cinder-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Acquiring lock "cinder-quobyte-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Lock "cinder-quobyte-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[09298753-e04e-41c6-a64e-b16c50b4fb74]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:56 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 Apr 29 18:21:56 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:56 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4" returned: 0 in 0.670s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:56 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4 Apr 29 18:21:56 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:57 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4" returned: 0 in 0.559s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Lock "cinder-quobyte-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4" released by "delete_volume" :: held 1.265s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Created reservations ['e4f58f57-4c66-4f98-8071-bfa853e3455c', '731d067a-cb63-40a6-8d84-270e92e5b459', '9272a4c0-639c-4043-b2a6-6a55dba13bc1', '77d9d280-545f-42c9-bd2d-182c1ab3550f'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:21:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:21:57 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:21:57 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:21:58 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Apr 29 18:21:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.552s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:21:58 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:21:58 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Deleted volume successfully. Apr 29 18:21:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-939549a5-9b41-4ee1-abac-af6264a5564a tempest-VolumesListTestJSON-877008844 None] Lock "cinder-6e05a3be-6e9f-4f5b-bd5f-6b18fa0cddc4-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:00 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Flow 'volume_create_manager' (2cb0343a-c0c8-405f-9cd2-fd2dd2bcbcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:00 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954ffe1d-45e5-4fad-b44a-1d193b2d64fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954ffe1d-45e5-4fad-b44a-1d193b2d64fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-162849254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a33f6d-5887-4a32-bbf6-7fd8919ba7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216d0d4dbe314b8eb4225586f212c0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:01Z,use_quota=True,user_id='709f3d14c2af4ab7950396d4347f3ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddd42fe-5445-41b9-b45c-dc65f41cf234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddd42fe-5445-41b9-b45c-dc65f41cf234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7b552f-498f-4312-82ba-2d2500e760a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7b552f-498f-4312-82ba-2d2500e760a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a33f6d-5887-4a32-bbf6-7fd8919ba7ac', 'volume_name': 'volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac', 'volume_size': 2}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809764ae-0e10-44d3-b0f8-6a825964b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809764ae-0e10-44d3-b0f8-6a825964b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abb888-6542-4be2-9f8e-c136063e2e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:01 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Volume 78a33f6d-5887-4a32-bbf6-7fd8919ba7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac', 'volume_size': 2} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-162849254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a33f6d-5887-4a32-bbf6-7fd8919ba7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216d0d4dbe314b8eb4225586f212c0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:01Z,use_quota=True,user_id='709f3d14c2af4ab7950396d4347f3ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Creating volume 78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:01 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac 2147483648 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:01 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac 2147483648 Apr 29 18:22:01 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:01 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac 2147483648" returned: 0 in 0.793s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:01 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac Apr 29 18:22:01 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:02 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" returned: 0 in 0.627s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abb888-6542-4be2-9f8e-c136063e2e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac', 'volume_size': 2}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdb92ad-3c79-40c0-b99d-0d063b6ccb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Volume volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac (78a33f6d-5887-4a32-bbf6-7fd8919ba7ac): created successfully Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdb92ad-3c79-40c0-b99d-0d063b6ccb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Flow 'volume_create_manager' (2cb0343a-c0c8-405f-9cd2-fd2dd2bcbcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-430ff4e3-57d6-4fe8-b297-68fbf5895f67 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Created volume successfully. Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Creating offline snapshot c7a06263-227c-4291-b218-bb1314774153 of volume 78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5157a245-f256-46f3-a254-c99718aa714e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:03 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac Apr 29 18:22:03 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:03 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" returned: 0 in 0.658s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 2G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:03 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 2G Apr 29 18:22:03 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:04 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 2G" returned: 0 in 0.703s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:04 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 Apr 29 18:22:04 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:05 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153" returned: 0 in 0.586s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:05 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 is being set with open permissions: ugo+rw Apr 29 18:22:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:05 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 Apr 29 18:22:05 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:05 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153" returned: 0 in 0.554s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:05 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info Apr 29 18:22:05 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:06 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info" returned: 0 in 0.552s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:06 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info is being set with open permissions: ugo+rw Apr 29 18:22:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:06 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info Apr 29 18:22:06 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:06 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.info" returned: 0 in 0.549s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.674s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a2d80628-e3b7-433b-be34-e9645745502f tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Create snapshot completed successfully Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "cinder-c7a06263-227c-4291-b218-bb1314774153-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-c7a06263-227c-4291-b218-bb1314774153-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "cinder-quobyte-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-quobyte-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "cinder-quobyte-c7a06263-227c-4291-b218-bb1314774153" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-quobyte-c7a06263-227c-4291-b218-bb1314774153" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Deleting offline snapshot c7a06263-227c-4291-b218-bb1314774153 of volume 78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] snapshot_file for this snap is: volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[72741c7f-76c6-434d-8f2e-d0c08cd6f31e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:07 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 Apr 29 18:22:07 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:08 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153" returned: 0 in 0.667s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:22:08 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[59871b8a-5a7d-40b9-8f88-67a54aebec21]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:08 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac Apr 29 18:22:08 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:08 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" returned: 0 in 0.670s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:08 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 Apr 29 18:22:08 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:09 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153" returned: 0 in 0.651s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:09 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153 Apr 29 18:22:09 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:10 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac.c7a06263-227c-4291-b218-bb1314774153" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-quobyte-c7a06263-227c-4291-b218-bb1314774153" released by "_delete_snapshot" :: held 2.682s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-quobyte-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" released by "delete_snapshot" :: held 2.705s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Created reservations ['206d6f44-703e-410e-adb7-dd32c1721cb2', '7b3442ea-cf51-4790-b9d5-44da2a30195f', '4d376685-cd56-4921-a7f1-3f2271620896', '26035a23-10c0-4b44-ba1f-f14687df6707'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Delete snapshot completed successfully. Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-637fc15f-46e7-4ec3-ab8a-6c90e7b9c60a tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-c7a06263-227c-4291-b218-bb1314774153-delete_snapshot" released by "delete_snapshot" :: held 2.832s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "cinder-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "cinder-quobyte-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-quobyte-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[0806e68b-1f0c-48b0-8926-6bc3c6f86f6c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:10 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac Apr 29 18:22:10 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:11 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" returned: 0 in 0.664s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:11 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac Apr 29 18:22:11 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:12 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" returned: 0 in 0.565s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-quobyte-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac" released by "delete_volume" :: held 1.287s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Created reservations ['1fd33881-9b6a-456b-a5f6-7735f875f01e', '90acd8a3-5920-4630-a9a9-70bd76218d8e', '8c53616a-e4a0-46af-8f6e-7928b45bf4eb', 'ce626499-4348-4e97-a834-b906fa648dc2'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:12 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:12 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:12 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.573s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Deleted volume successfully. Apr 29 18:22:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-cf44d50f-9aac-48f9-b7c0-8f4479e6af47 tempest-VolumesSnapshotNegativeTestJSON-57766821 None] Lock "cinder-78a33f6d-5887-4a32-bbf6-7fd8919ba7ac-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:22 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=35,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=11 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:22:22 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=34,cinder:UPDATE=48,cinder:INSERT=13,cinder:DELETE=3 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (5881ed7e-891f-468f-ba39-d1b74d530432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201eb9a2-9c96-48dd-a636-949a4c608ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201eb9a2-9c96-48dd-a636-949a4c608ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-890821421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53142b20-c49d-4767-a932-190e1fbb89f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:24Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8011f589-c629-4121-982a-01fe883e3e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8011f589-c629-4121-982a-01fe883e3e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d64fdca-3861-49ef-9153-710f9f40e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d64fdca-3861-49ef-9153-710f9f40e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53142b20-c49d-4767-a932-190e1fbb89f9', 'volume_name': 'volume-53142b20-c49d-4767-a932-190e1fbb89f9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2123ff84-7e1f-41d0-bd0d-78d676d7ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2123ff84-7e1f-41d0-bd0d-78d676d7ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b2a7ef-1abd-484c-85de-0845867a2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:23 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Volume 53142b20-c49d-4767-a932-190e1fbb89f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53142b20-c49d-4767-a932-190e1fbb89f9', 'volume_size': 1} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-890821421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53142b20-c49d-4767-a932-190e1fbb89f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:24Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Creating volume 53142b20-c49d-4767-a932-190e1fbb89f9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:23 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:24 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 1073741824 Apr 29 18:22:24 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (167f8548-7b9b-441d-bbe1-546efed6b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05394b9-1b9f-49b3-9d26-55ffaea436be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05394b9-1b9f-49b3-9d26-55ffaea436be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023969167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e621b4-5052-44c0-bc77-a2e1744d58c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:24Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a342b9-0f1c-4ebb-bb2a-515527bd4937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a342b9-0f1c-4ebb-bb2a-515527bd4937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89b9606-b892-485e-801d-5bb4ed830e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89b9606-b892-485e-801d-5bb4ed830e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e621b4-5052-44c0-bc77-a2e1744d58c9', 'volume_name': 'volume-65e621b4-5052-44c0-bc77-a2e1744d58c9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc715d74-87ac-4abc-b5eb-be0c535bbb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc715d74-87ac-4abc-b5eb-be0c535bbb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed41148a-e7cc-48e3-8b21-b29de0a4748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume 65e621b4-5052-44c0-bc77-a2e1744d58c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e621b4-5052-44c0-bc77-a2e1744d58c9', 'volume_size': 1} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (404686a0-779a-494f-a589-3527bc33b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c199ba-3955-4edf-af8e-cbc6e8ce6f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c199ba-3955-4edf-af8e-cbc6e8ce6f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-959318367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d4c86b-dd6b-4b7c-b959-e3bf8e548151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:24Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988d030-35be-4f9f-b7e4-3ad748603211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988d030-35be-4f9f-b7e4-3ad748603211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5df61fb-389f-4360-b431-ffc314d70922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5df61fb-389f-4360-b431-ffc314d70922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d4c86b-dd6b-4b7c-b959-e3bf8e548151', 'volume_name': 'volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b8c761-5875-4f56-8fcc-46c5c943a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b8c761-5875-4f56-8fcc-46c5c943a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a97da1-dcd1-4468-8f74-403e96f8e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Volume 71d4c86b-dd6b-4b7c-b959-e3bf8e548151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151', 'volume_size': 1} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (dc5b4a0f-bb3e-4b1d-925d-b0774794ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46c1aac-89dd-4a39-830b-e98223ac2a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46c1aac-89dd-4a39-830b-e98223ac2a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-975665594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f7245f-fdc1-4964-a1a0-d6716d20ed60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7cd9989df244f09f6ec49cfd179e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:25Z,use_quota=True,user_id='267c82a5bab946bf991d031419ee5bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d193a8-135c-4932-b222-41614305a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d193a8-135c-4932-b222-41614305a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb3a3e1-bb46-4933-b840-d859a108999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb3a3e1-bb46-4933-b840-d859a108999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f7245f-fdc1-4964-a1a0-d6716d20ed60', 'volume_name': 'volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf91c393-7084-4d58-9a05-6bd5ff1fd63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf91c393-7084-4d58-9a05-6bd5ff1fd63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f8401f-7611-4e47-a1e2-c1cfb091a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Volume d9f7245f-fdc1-4964-a1a0-d6716d20ed60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60', 'volume_size': 1} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (4d25a013-85e6-4113-b70c-e109ab6a05ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef73f792-fbb3-4b6a-a771-4bae7b873288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef73f792-fbb3-4b6a-a771-4bae7b873288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-937177426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a249bc8-8f98-4a43-905e-f7dea447a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:25Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fbe60f-335e-4702-88e8-00b3e291c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fbe60f-335e-4702-88e8-00b3e291c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d7fb64-8f71-4102-9dc1-e1fa5bd4db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d7fb64-8f71-4102-9dc1-e1fa5bd4db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a249bc8-8f98-4a43-905e-f7dea447a028', 'volume_name': 'volume-0a249bc8-8f98-4a43-905e-f7dea447a028', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbb251c-5e4f-4bdc-9f0a-ebd5f0b2f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbb251c-5e4f-4bdc-9f0a-ebd5f0b2f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee59e5f-e2fc-436e-aab8-8b38862911b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:24 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Volume 0a249bc8-8f98-4a43-905e-f7dea447a028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a249bc8-8f98-4a43-905e-f7dea447a028', 'volume_size': 1} Apr 29 18:22:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:25 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 1073741824" returned: 0 in 1.102s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:25 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 Apr 29 18:22:25 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (17e493c6-d773-4469-9657-b516ab02b4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710133d1-ceda-4020-9d77-10557169cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710133d1-ceda-4020-9d77-10557169cde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1516988520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946df836-82c6-43f8-9288-2734059bb1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:25Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f89844-8344-4a03-a941-491c284ac6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f89844-8344-4a03-a941-491c284ac6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f1982b-679f-42ce-99d4-1b8cf7293ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f1982b-679f-42ce-99d4-1b8cf7293ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946df836-82c6-43f8-9288-2734059bb1a1', 'volume_name': 'volume-946df836-82c6-43f8-9288-2734059bb1a1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823008be-6f6f-4539-89a3-21710368d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823008be-6f6f-4539-89a3-21710368d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ebcee0-bd7a-4228-89ef-c1100bed3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Volume 946df836-82c6-43f8-9288-2734059bb1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946df836-82c6-43f8-9288-2734059bb1a1', 'volume_size': 1} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (23fe4885-90c4-49ad-a2af-6f07a9d6a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3856805-05ba-41a5-895f-54b2c4cf0187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3856805-05ba-41a5-895f-54b2c4cf0187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821636049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10b6815-be98-4c9a-bdb6-271900d9d06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:26Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3132bda0-9ba2-4715-9232-44aa844882ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3132bda0-9ba2-4715-9232-44aa844882ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2190f141-d15c-4986-b51c-0a8066f30121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2190f141-d15c-4986-b51c-0a8066f30121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10b6815-be98-4c9a-bdb6-271900d9d06e', 'volume_name': 'volume-d10b6815-be98-4c9a-bdb6-271900d9d06e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c726d-7606-46af-a052-2508ae307904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c726d-7606-46af-a052-2508ae307904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbf52db-5e27-438a-b2db-d8ee2696fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Volume d10b6815-be98-4c9a-bdb6-271900d9d06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10b6815-be98-4c9a-bdb6-271900d9d06e', 'volume_size': 1} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:25 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9" returned: 0 in 0.681s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023969167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e621b4-5052-44c0-bc77-a2e1744d58c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:24Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating volume 65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:25 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b2a7ef-1abd-484c-85de-0845867a2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53142b20-c49d-4767-a932-190e1fbb89f9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 1073741824 Apr 29 18:22:25 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136ee765-4b3d-4887-9756-99965773ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:25 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Volume volume-53142b20-c49d-4767-a932-190e1fbb89f9 (53142b20-c49d-4767-a932-190e1fbb89f9): created successfully Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136ee765-4b3d-4887-9756-99965773ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:25 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (5881ed7e-891f-468f-ba39-d1b74d530432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:25 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5f958de4-b0fd-4af3-9575-6f26faf8cc32 tempest-CreateVolumesFromImageTest-237131635 None] Created volume successfully. Apr 29 18:22:26 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 1073741824" returned: 0 in 0.813s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:26 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 Apr 29 18:22:26 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:27 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9" returned: 0 in 0.641s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.698s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-959318367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d4c86b-dd6b-4b7c-b959-e3bf8e548151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:24Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Creating volume 71d4c86b-dd6b-4b7c-b959-e3bf8e548151 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:27 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed41148a-e7cc-48e3-8b21-b29de0a4748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e621b4-5052-44c0-bc77-a2e1744d58c9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:27 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 1073741824 Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec233c26-c1f8-4a9d-8420-1e03bdeb6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:27 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:27 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 (65e621b4-5052-44c0-bc77-a2e1744d58c9): created successfully Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec233c26-c1f8-4a9d-8420-1e03bdeb6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (167f8548-7b9b-441d-bbe1-546efed6b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:27 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ea0a6a5a-e35f-4e3a-a439-a705639d8f57 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created volume successfully. Apr 29 18:22:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:28 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 1073741824" returned: 0 in 1.002s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:28 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 Apr 29 18:22:28 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:28 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151" returned: 0 in 0.603s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.129s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-975665594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f7245f-fdc1-4964-a1a0-d6716d20ed60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7cd9989df244f09f6ec49cfd179e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:25Z,use_quota=True,user_id='267c82a5bab946bf991d031419ee5bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Creating volume d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:28 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a97da1-dcd1-4468-8f74-403e96f8e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:28 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 1073741824 Apr 29 18:22:28 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb49a5b-a31f-43b3-9b78-be803f0f6f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:29 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Volume volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 (71d4c86b-dd6b-4b7c-b959-e3bf8e548151): created successfully Apr 29 18:22:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb49a5b-a31f-43b3-9b78-be803f0f6f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (404686a0-779a-494f-a589-3527bc33b1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:29 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-909166be-785f-480e-a9c7-30dd86e4cc3b tempest-CreateVolumesFromImageTest-237131635 None] Created volume successfully. Apr 29 18:22:29 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 1073741824" returned: 0 in 0.807s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:29 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:22:29 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:30 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 0.601s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.446s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-937177426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a249bc8-8f98-4a43-905e-f7dea447a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:25Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Creating volume 0a249bc8-8f98-4a43-905e-f7dea447a028 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:30 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f8401f-7611-4e47-a1e2-c1cfb091a35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:30 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 1073741824 Apr 29 18:22:30 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3b33d1-041a-431d-89eb-da8cf89ae68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:30 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Volume volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 (d9f7245f-fdc1-4964-a1a0-d6716d20ed60): created successfully Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3b33d1-041a-431d-89eb-da8cf89ae68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:30 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (dc5b4a0f-bb3e-4b1d-925d-b0774794ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:30 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-4d5cae8b-819c-4430-90e1-52cf8746958f tempest-VolumeDependencyTests-1617016056 None] Created volume successfully. Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:31 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 1073741824" returned: 0 in 0.882s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:31 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 Apr 29 18:22:31 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:31 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028" returned: 0 in 0.598s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.534s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1516988520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946df836-82c6-43f8-9288-2734059bb1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:25Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Creating volume 946df836-82c6-43f8-9288-2734059bb1a1 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:31 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:31 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 1073741824 Apr 29 18:22:31 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee59e5f-e2fc-436e-aab8-8b38862911b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a249bc8-8f98-4a43-905e-f7dea447a028', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071dd7e1-9194-4279-8eed-40bb315228e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:32 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Volume volume-0a249bc8-8f98-4a43-905e-f7dea447a028 (0a249bc8-8f98-4a43-905e-f7dea447a028): created successfully Apr 29 18:22:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071dd7e1-9194-4279-8eed-40bb315228e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:32 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (4d25a013-85e6-4113-b70c-e109ab6a05ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:32 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ed9af69a-672b-4fa4-bb28-00e3aea0b373 tempest-CreateVolumesFromImageTest-237131635 None] Created volume successfully. Apr 29 18:22:32 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 1073741824" returned: 0 in 0.835s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:32 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 Apr 29 18:22:32 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:33 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1" returned: 0 in 0.600s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.670s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821636049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10b6815-be98-4c9a-bdb6-271900d9d06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297ba6d4580f4e6abe58f4c49ed8c2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:26Z,use_quota=True,user_id='52103437c2924549aa5680b526bf4c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Creating volume d10b6815-be98-4c9a-bdb6-271900d9d06e {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:33 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ebcee0-bd7a-4228-89ef-c1100bed3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946df836-82c6-43f8-9288-2734059bb1a1', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:33 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e 1073741824 Apr 29 18:22:33 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d57490-6b8b-4193-b9da-19b57dcf0151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:33 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Volume volume-946df836-82c6-43f8-9288-2734059bb1a1 (946df836-82c6-43f8-9288-2734059bb1a1): created successfully Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d57490-6b8b-4193-b9da-19b57dcf0151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:33 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (17e493c6-d773-4469-9657-b516ab02b4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-cb6fad33-ca8d-49fe-9001-c47b793d6dbc tempest-CreateVolumesFromImageTest-237131635 None] Created volume successfully. Apr 29 18:22:34 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e 1073741824" returned: 0 in 0.824s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:34 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e Apr 29 18:22:34 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:34 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e" returned: 0 in 0.613s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.195s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbf52db-5e27-438a-b2db-d8ee2696fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10b6815-be98-4c9a-bdb6-271900d9d06e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f1c686-5682-4510-a009-8dacb2aa572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating offline snapshot bc0b0a0c-245f-45dc-971a-99c016fa17b8 of volume 65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:22:34 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Volume volume-d10b6815-be98-4c9a-bdb6-271900d9d06e (d10b6815-be98-4c9a-bdb6-271900d9d06e): created successfully Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f1c686-5682-4510-a009-8dacb2aa572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Flow 'volume_create_manager' (23fe4885-90c4-49ad-a2af-6f07a9d6a26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6fc356-08aa-4c0c-95fa-64ad33d9f75b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:35 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-91d52702-1a1e-4e70-bbc1-0c5a6fc757cc tempest-CreateVolumesFromImageTest-237131635 None] Created volume successfully. Apr 29 18:22:35 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 Apr 29 18:22:35 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-d10b6815-be98-4c9a-bdb6-271900d9d06e-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-d10b6815-be98-4c9a-bdb6-271900d9d06e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-quobyte-d10b6815-be98-4c9a-bdb6-271900d9d06e" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-d10b6815-be98-4c9a-bdb6-271900d9d06e" acquired by "delete_volume" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[086ff0e6-1caa-4f25-8bf4-4764b2551e99]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:35 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9" returned: 0 in 0.872s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:35 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:35 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:35 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 1G Apr 29 18:22:35 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:35 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e Apr 29 18:22:35 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:36 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.812s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:36 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:36 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e" returned: 0 in 0.892s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:36 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e Apr 29 18:22:36 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:36 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 1G" returned: 0 in 0.904s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:36 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 Apr 29 18:22:36 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:37 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d10b6815-be98-4c9a-bdb6-271900d9d06e" returned: 0 in 0.663s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-d10b6815-be98-4c9a-bdb6-271900d9d06e" released by "delete_volume" :: held 1.616s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Created reservations ['d44ced9e-a9bc-41c8-9dd5-70e1c9ea32fd', 'ba1934ee-93dd-4646-8eb7-d8de54fa93f5', 'ded220d2-af31-4b85-99f2-d7bdba68f305', 'c93c277e-8808-481f-ae1b-ed45a7ad0f44'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:37 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8" returned: 0 in 0.694s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:37 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 is being set with open permissions: ugo+rw Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:37 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 Apr 29 18:22:37 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:37 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:37 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-946df836-82c6-43f8-9288-2734059bb1a1-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:37 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-946df836-82c6-43f8-9288-2734059bb1a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-quobyte-946df836-82c6-43f8-9288-2734059bb1a1" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-946df836-82c6-43f8-9288-2734059bb1a1" acquired by "delete_volume" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2679983f-3823-433c-9de0-0e71692175ab]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:38 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8" returned: 0 in 0.733s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:38 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 Apr 29 18:22:38 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:38 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info Apr 29 18:22:38 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:38 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.728s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:38 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Deleted volume successfully. Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-054b5fca-3fcf-4020-8ff6-c6a3f1396973 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-d10b6815-be98-4c9a-bdb6-271900d9d06e-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:38 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info" returned: 0 in 0.669s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:38 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info is being set with open permissions: ugo+rw Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:38 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info Apr 29 18:22:38 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:38 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1" returned: 0 in 0.829s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:38 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1 Apr 29 18:22:38 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:39 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.info" returned: 0 in 0.610s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.620s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.338s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:39 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-946df836-82c6-43f8-9288-2734059bb1a1" returned: 0 in 0.656s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Creating offline snapshot 57f8ac10-5168-4a02-ba41-d6d4feb706a7 of volume d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-946df836-82c6-43f8-9288-2734059bb1a1" released by "delete_volume" :: held 1.590s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:39 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-bec223ac-5c8e-4469-84f7-62a4e411f773 tempest-CreateVolumesFromSnapshotTest-697883746 None] Create snapshot completed successfully Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[141205dd-8ef6-4790-a70d-e22f6e3ee1dd]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Created reservations ['fdf3b497-9feb-434e-b7ee-d5d2a70bc41e', '320b61ca-6fd9-4f16-9bde-5d571719d904', '9fdc783b-68f7-40b8-809e-39ede45b9e1b', '80aa3724-208a-4c93-a826-2bc822ee92b8'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:39 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:22:39 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:39 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:39 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:39 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-0a249bc8-8f98-4a43-905e-f7dea447a028-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-0a249bc8-8f98-4a43-905e-f7dea447a028-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-quobyte-0a249bc8-8f98-4a43-905e-f7dea447a028" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-0a249bc8-8f98-4a43-905e-f7dea447a028" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe48fa-d783-4c60-8733-c17d4f1c35ee]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:40 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.786s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:40 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Deleted volume successfully. Apr 29 18:22:40 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-1212a3f2-ebdf-4e1b-b1e3-9114ff6fe7a7 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-946df836-82c6-43f8-9288-2734059bb1a1-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:40 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:40 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 1.035s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:40 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 1G Apr 29 18:22:40 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (802e4315-f817-44e6-89c1-88e413cdaf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8195224-6761-43ad-a77a-dd0115e2b147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8195224-6761-43ad-a77a-dd0115e2b147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110854626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22181acb-3084-45f4-8328-797279e3c18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:41Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d216c42-46c8-45ca-93e3-8a03160c9c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d216c42-46c8-45ca-93e3-8a03160c9c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caa7b89-9417-4d92-a861-ddcda745ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caa7b89-9417-4d92-a861-ddcda745ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22181acb-3084-45f4-8328-797279e3c18d', 'volume_name': 'volume-22181acb-3084-45f4-8328-797279e3c18d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f820555-0f0d-45d0-a2e4-7fdd1530edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f820555-0f0d-45d0-a2e4-7fdd1530edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206ed613-f201-4443-b31e-bff40ae6a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:40 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume 22181acb-3084-45f4-8328-797279e3c18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22181acb-3084-45f4-8328-797279e3c18d', 'volume_size': 1} Apr 29 18:22:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (23ab4499-f852-4d90-9110-eefe21e74999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1437be8-9693-4d70-aafe-aadbd0a7528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1437be8-9693-4d70-aafe-aadbd0a7528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300773772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791c8abb-4597-4b53-adab-fb58cb93ba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:41Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad42dd90-411a-4d3c-8d97-ce62ce7d4525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad42dd90-411a-4d3c-8d97-ce62ce7d4525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d18012e-eae3-4637-9ec0-297495bd8acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d18012e-eae3-4637-9ec0-297495bd8acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791c8abb-4597-4b53-adab-fb58cb93ba11', 'volume_name': 'volume-791c8abb-4597-4b53-adab-fb58cb93ba11', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c033885-0ad5-4670-9774-1ef8ba631f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c033885-0ad5-4670-9774-1ef8ba631f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8122ebca-ba3f-409e-9e6c-7d7d4144095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:41 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume 791c8abb-4597-4b53-adab-fb58cb93ba11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791c8abb-4597-4b53-adab-fb58cb93ba11', 'volume_size': 1} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:41 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028" returned: 0 in 1.218s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:41 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028 Apr 29 18:22:41 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (38940b31-8527-4ed5-b34c-7df7faef169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92793bab-0e1d-4d7a-8697-e2cb83fed636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:41 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92793bab-0e1d-4d7a-8697-e2cb83fed636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693167372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a50235-d094-4d15-9fea-fa71a39c22ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:42Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0725ed06-b17f-462a-9001-2d17f81d23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0725ed06-b17f-462a-9001-2d17f81d23b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94422ec8-125a-4b2f-af25-d718cf22ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94422ec8-125a-4b2f-af25-d718cf22ff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a50235-d094-4d15-9fea-fa71a39c22ec', 'volume_name': 'volume-e3a50235-d094-4d15-9fea-fa71a39c22ec', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff19be2-5448-4ddf-80e0-c77330eaa71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff19be2-5448-4ddf-80e0-c77330eaa71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8447626-6b76-499d-9122-b28c1f2bce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume e3a50235-d094-4d15-9fea-fa71a39c22ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a50235-d094-4d15-9fea-fa71a39c22ec', 'volume_size': 1} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 1G" returned: 0 in 1.332s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:42 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 Apr 29 18:22:42 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (271eff5a-85b0-4a13-a343-028243ceb5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce03eac-a183-4f72-9f70-e4886ae08328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce03eac-a183-4f72-9f70-e4886ae08328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870272460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e879ae3-f2f8-4849-83e4-c18c3d69a4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:42Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ceb4f7-c78a-41c8-aac7-7eebe6983fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ceb4f7-c78a-41c8-aac7-7eebe6983fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05574a77-a50b-482c-9062-8c86c6ed76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05574a77-a50b-482c-9062-8c86c6ed76a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e879ae3-f2f8-4849-83e4-c18c3d69a4f9', 'volume_name': 'volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94990183-392e-47a1-87dd-e329cc7315ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94990183-392e-47a1-87dd-e329cc7315ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02357c6c-5271-4c90-9492-7d53654ead95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume 2e879ae3-f2f8-4849-83e4-c18c3d69a4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9', 'volume_size': 1} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-0a249bc8-8f98-4a43-905e-f7dea447a028" returned: 0 in 0.797s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-0a249bc8-8f98-4a43-905e-f7dea447a028" released by "delete_volume" :: held 2.081s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Created reservations ['9899bde7-ac93-4c36-af5c-27c9860a60b4', '08d89c6f-6417-47cd-aa66-21778d47c78a', '1df1de14-b44e-469e-a748-b45545767c6b', 'aca7ad8a-d54f-4a11-be0d-88f82286503e'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (58597040-3353-460e-b913-962d37f781e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6fa781-772a-4d74-b3c5-a08152fbcaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6fa781-772a-4d74-b3c5-a08152fbcaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1672758127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f49b330-42e1-4650-97a4-ae3de5980dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:43Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68795b14-19be-4448-b7d4-ae4f5cd62182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68795b14-19be-4448-b7d4-ae4f5cd62182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9509ede5-a013-49d3-a079-284554d3dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9509ede5-a013-49d3-a079-284554d3dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f49b330-42e1-4650-97a4-ae3de5980dc0', 'volume_name': 'volume-6f49b330-42e1-4650-97a4-ae3de5980dc0', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8a07c4-afbb-4b37-addb-90a18461f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8a07c4-afbb-4b37-addb-90a18461f74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856a3bc8-962e-4be4-87b0-8a059f3f1c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:42 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume 6f49b330-42e1-4650-97a4-ae3de5980dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f49b330-42e1-4650-97a4-ae3de5980dc0', 'volume_size': 1} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:42 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:42 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:42 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7" returned: 0 in 0.842s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:42 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 is being set with open permissions: ugo+rw Apr 29 18:22:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:42 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 Apr 29 18:22:42 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:43 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.595s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:43 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Deleted volume successfully. Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-72c4598d-3141-4f33-b4ea-880cecdf1ce3 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-0a249bc8-8f98-4a43-905e-f7dea447a028-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:43 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7" returned: 0 in 0.606s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:43 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info Apr 29 18:22:43 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-71d4c86b-dd6b-4b7c-b959-e3bf8e548151-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-71d4c86b-dd6b-4b7c-b959-e3bf8e548151-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-quobyte-71d4c86b-dd6b-4b7c-b959-e3bf8e548151" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-71d4c86b-dd6b-4b7c-b959-e3bf8e548151" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[096f9d8b-fbc5-4fb1-89c6-8683d6839b93]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:43 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 Apr 29 18:22:43 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:44 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info" returned: 0 in 0.641s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:44 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info is being set with open permissions: ugo+rw Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:44 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info Apr 29 18:22:44 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:44 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151" returned: 0 in 0.801s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:44 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151 Apr 29 18:22:44 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:44 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.info" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110854626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22181acb-3084-45f4-8328-797279e3c18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:41Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating volume 22181acb-3084-45f4-8328-797279e3c18d {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:44 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:45 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d 1073741824 Apr 29 18:22:45 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:45 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-33652046-138b-4def-8c83-7fb889d132f7 tempest-VolumeDependencyTests-1617016056 None] Create snapshot completed successfully Apr 29 18:22:45 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-71d4c86b-dd6b-4b7c-b959-e3bf8e548151" returned: 0 in 0.607s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-71d4c86b-dd6b-4b7c-b959-e3bf8e548151" released by "delete_volume" :: held 1.467s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Created reservations ['0df763f0-043d-4153-9d74-86977500fa7a', 'd6e9ff2b-ae83-4fb1-a4b8-93bffa57f739', '43b40725-f287-4937-bf5b-eada754e87e0', 'aca303d0-e1da-42ad-abc0-47e22eaee324'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:45 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:45 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Flow 'volume_create_manager' (86fd5c68-237a-4e54-9b81-8a7b20a807b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb301cdc-c83a-4d76-b6aa-445cea04746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb301cdc-c83a-4d76-b6aa-445cea04746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1587096649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905b3f31-de66-47c2-92fb-44bf34963211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce6a51e3b74f7bbac2898ad1416cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:46Z,use_quota=True,user_id='fefbc8326bec4e428ca871402f832d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877e545b-1235-4f45-b5a9-f226dcb545f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877e545b-1235-4f45-b5a9-f226dcb545f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16a0b1d-8974-482e-99b4-3cd68bcedb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16a0b1d-8974-482e-99b4-3cd68bcedb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905b3f31-de66-47c2-92fb-44bf34963211', 'volume_name': 'volume-905b3f31-de66-47c2-92fb-44bf34963211', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded73426-7517-4820-a409-2e35f233f4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded73426-7517-4820-a409-2e35f233f4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041952af-3782-4142-ae3d-5bea78c0f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:45 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Volume 905b3f31-de66-47c2-92fb-44bf34963211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905b3f31-de66-47c2-92fb-44bf34963211', 'volume_size': 1} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:45 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d 1073741824" returned: 0 in 0.849s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:45 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d Apr 29 18:22:45 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-53142b20-c49d-4767-a932-190e1fbb89f9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:45 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.636s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Deleted volume successfully. Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-53142b20-c49d-4767-a932-190e1fbb89f9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-766b1349-c136-4083-a12c-fd8d60460ef8 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-71d4c86b-dd6b-4b7c-b959-e3bf8e548151-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "cinder-quobyte-53142b20-c49d-4767-a932-190e1fbb89f9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-53142b20-c49d-4767-a932-190e1fbb89f9" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ebf28-67c0-4208-9e78-a746f6e35716]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:46 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 Apr 29 18:22:46 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:46 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d" returned: 0 in 0.749s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.115s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300773772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791c8abb-4597-4b53-adab-fb58cb93ba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:41Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating volume 791c8abb-4597-4b53-adab-fb58cb93ba11 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:46 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:46 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 1073741824 Apr 29 18:22:46 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206ed613-f201-4443-b31e-bff40ae6a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22181acb-3084-45f4-8328-797279e3c18d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cf52be-a33d-4eee-93b0-9c1c1fedf205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (973a04df-5a20-422b-adc1-5ece8404b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf67201-f645-4461-b197-7167da9d5c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume volume-22181acb-3084-45f4-8328-797279e3c18d (22181acb-3084-45f4-8328-797279e3c18d): created successfully Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cf52be-a33d-4eee-93b0-9c1c1fedf205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (802e4315-f817-44e6-89c1-88e413cdaf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf67201-f645-4461-b197-7167da9d5c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1935029938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad53f71c-548a-435c-9c9d-add89154827f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7cd9989df244f09f6ec49cfd179e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57f8ac10-5168-4a02-ba41-d6d4feb706a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:47Z,use_quota=True,user_id='267c82a5bab946bf991d031419ee5bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3d7bbf-497c-4430-a801-1b534dd66ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3d7bbf-497c-4430-a801-1b534dd66ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1ba48b-8de4-4449-83d2-92d5efbab14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1ba48b-8de4-4449-83d2-92d5efbab14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad53f71c-548a-435c-9c9d-add89154827f', 'volume_name': 'volume-ad53f71c-548a-435c-9c9d-add89154827f', 'volume_size': 1, 'snapshot_id': '57f8ac10-5168-4a02-ba41-d6d4feb706a7'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c464e4-6308-4e2c-a8dc-962561ac6983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c464e4-6308-4e2c-a8dc-962561ac6983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ed0cfc-6845-4424-9856-22d203f2f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Volume ad53f71c-548a-435c-9c9d-add89154827f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad53f71c-548a-435c-9c9d-add89154827f', 'volume_size': 1, 'snapshot_id': '57f8ac10-5168-4a02-ba41-d6d4feb706a7'} Apr 29 18:22:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-606a4b1f-e43c-4892-a44a-4ae488026d75 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created volume successfully. Apr 29 18:22:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:47 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9" returned: 0 in 0.860s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:47 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9 Apr 29 18:22:47 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:47 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 1073741824" returned: 0 in 0.902s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:47 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 Apr 29 18:22:47 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:47 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-53142b20-c49d-4767-a932-190e1fbb89f9" returned: 0 in 0.606s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-quobyte-53142b20-c49d-4767-a932-190e1fbb89f9" released by "delete_volume" :: held 1.547s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Created reservations ['c74ab82d-dbde-464b-8760-a7b968a757e8', '55ceb776-01c1-437a-bfca-ec55335fd2c6', '9a9f4d3b-2e21-4216-a1c1-2fbf677c7368', 'c1fa4d1d-8c79-4c1d-82e3-acd1c52cf353'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:47 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:47 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:48 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11" returned: 0 in 0.611s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.124s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693167372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a50235-d094-4d15-9fea-fa71a39c22ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:42Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating volume e3a50235-d094-4d15-9fea-fa71a39c22ec {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:48 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8122ebca-ba3f-409e-9e6c-7d7d4144095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791c8abb-4597-4b53-adab-fb58cb93ba11', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8de072-7754-4c22-a9cb-3a141b03475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:48 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec 1073741824 Apr 29 18:22:48 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:48 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume volume-791c8abb-4597-4b53-adab-fb58cb93ba11 (791c8abb-4597-4b53-adab-fb58cb93ba11): created successfully Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8de072-7754-4c22-a9cb-3a141b03475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (23ab4499-f852-4d90-9110-eefe21e74999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:48 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-ff523e26-c7e7-4150-86c4-d59aefca0d37 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created volume successfully. Apr 29 18:22:48 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.658s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:48 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Deleted volume successfully. Apr 29 18:22:48 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-40b08f0b-ed7d-4169-be0b-1fbbf1dc9e60 tempest-CreateVolumesFromImageTest-237131635 None] Lock "cinder-53142b20-c49d-4767-a932-190e1fbb89f9-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:49 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec 1073741824" returned: 0 in 0.876s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:49 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec Apr 29 18:22:49 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:49 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec" returned: 0 in 0.621s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.273s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870272460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e879ae3-f2f8-4849-83e4-c18c3d69a4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:42Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating volume 2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:49 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:49 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 1073741824 Apr 29 18:22:49 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8447626-6b76-499d-9122-b28c1f2bce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a50235-d094-4d15-9fea-fa71a39c22ec', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1029aec2-4aaa-4b81-a9cc-b3314d2c8fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:49 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume volume-e3a50235-d094-4d15-9fea-fa71a39c22ec (e3a50235-d094-4d15-9fea-fa71a39c22ec): created successfully Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1029aec2-4aaa-4b81-a9cc-b3314d2c8fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:49 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (38940b31-8527-4ed5-b34c-7df7faef169d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9d741f06-7bc2-485c-8e22-fa4a75a61a77 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created volume successfully. Apr 29 18:22:50 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 1073741824" returned: 0 in 0.816s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:50 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 Apr 29 18:22:50 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:50 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (5a064179-991b-495c-84d5-982d708bea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0916d5fe-391d-421b-bd59-0caf57b92453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0916d5fe-391d-421b-bd59-0caf57b92453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104158930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a587bc-2a4f-456e-b102-4b8afd5214b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:51Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca34951-dcdc-44df-9e91-b029b97cac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca34951-dcdc-44df-9e91-b029b97cac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc9dd8-29b9-4a56-abbd-93af39665813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc9dd8-29b9-4a56-abbd-93af39665813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a587bc-2a4f-456e-b102-4b8afd5214b9', 'volume_name': 'volume-82a587bc-2a4f-456e-b102-4b8afd5214b9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58347507-33e5-49b1-8818-d5da3933ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58347507-33e5-49b1-8818-d5da3933ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebb067f-829c-41ac-9469-b8220116beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:51 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume 82a587bc-2a4f-456e-b102-4b8afd5214b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a587bc-2a4f-456e-b102-4b8afd5214b9', 'volume_size': 1} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:51 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9" returned: 0 in 0.616s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.504s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1672758127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f49b330-42e1-4650-97a4-ae3de5980dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0ffb96e5cb418aad3f386fb7e2d1a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:43Z,use_quota=True,user_id='4a2f03f8c6424a729678db7943f0f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Creating volume 6f49b330-42e1-4650-97a4-ae3de5980dc0 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:51 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02357c6c-5271-4c90-9492-7d53654ead95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:51 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 1073741824 Apr 29 18:22:51 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee3dde4-c488-45f1-8cb4-d5d5ebc7f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:51 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 (2e879ae3-f2f8-4849-83e4-c18c3d69a4f9): created successfully Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee3dde4-c488-45f1-8cb4-d5d5ebc7f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:51 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (271eff5a-85b0-4a13-a343-028243ceb5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:51 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-1dde9285-a21a-44e8-b0a0-3a6de79a5ab3 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created volume successfully. Apr 29 18:22:52 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 1073741824" returned: 0 in 0.781s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:52 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 Apr 29 18:22:52 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:52 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0" returned: 0 in 0.649s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1587096649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905b3f31-de66-47c2-92fb-44bf34963211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce6a51e3b74f7bbac2898ad1416cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:46Z,use_quota=True,user_id='fefbc8326bec4e428ca871402f832d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Creating volume 905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:52 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:52 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 1073741824 Apr 29 18:22:52 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856a3bc8-962e-4be4-87b0-8a059f3f1c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f49b330-42e1-4650-97a4-ae3de5980dc0', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28823a4-bbad-405a-a0e6-10426d81f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:52 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Volume volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 (6f49b330-42e1-4650-97a4-ae3de5980dc0): created successfully Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28823a4-bbad-405a-a0e6-10426d81f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:52 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Flow 'volume_create_manager' (58597040-3353-460e-b913-962d37f781e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a26d02e5-2546-4d47-a872-fdf64a943a15 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created volume successfully. Apr 29 18:22:53 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 1073741824" returned: 0 in 0.727s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:53 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:22:53 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-6f49b330-42e1-4650-97a4-ae3de5980dc0-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-6f49b330-42e1-4650-97a4-ae3de5980dc0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-6f49b330-42e1-4650-97a4-ae3de5980dc0" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-6f49b330-42e1-4650-97a4-ae3de5980dc0" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb4a8de-0341-4dc1-a2dc-8f766d8daeca]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:53 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 Apr 29 18:22:53 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:54 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.268s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-57f8ac10-5168-4a02-ba41-d6d4feb706a7-ad53f71c-548a-435c-9c9d-add89154827f" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041952af-3782-4142-ae3d-5bea78c0f926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905b3f31-de66-47c2-92fb-44bf34963211', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9597f5ca-932b-48b5-ac10-ef91dc6edaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-57f8ac10-5168-4a02-ba41-d6d4feb706a7-ad53f71c-548a-435c-9c9d-add89154827f" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Creating volume ad53f71c-548a-435c-9c9d-add89154827f from snapshot 57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-ad53f71c-548a-435c-9c9d-add89154827f" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:54 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Volume volume-905b3f31-de66-47c2-92fb-44bf34963211 (905b3f31-de66-47c2-92fb-44bf34963211): created successfully Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9597f5ca-932b-48b5-ac10-ef91dc6edaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Flow 'volume_create_manager' (86fd5c68-237a-4e54-9b81-8a7b20a807b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-ad53f71c-548a-435c-9c9d-add89154827f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] snapshot: 57f8ac10-5168-4a02-ba41-d6d4feb706a7, volume: ad53f71c-548a-435c-9c9d-add89154827f, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:22:54 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-397beb73-ae0b-4eae-9bc8-ef70497be407 tempest-SnapshotDependencyTests-1172365818 None] Created volume successfully. Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7290a3f1-2ae6-452f-8de7-4ff9bc3e6060]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:54 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 Apr 29 18:22:54 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:54 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0" returned: 0 in 0.744s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:54 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0 Apr 29 18:22:54 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:54 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7" returned: 0 in 0.696s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33a9edd-89a8-4aa5-a8f6-62a219ebd1f3]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:55 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:22:55 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:55 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-6f49b330-42e1-4650-97a4-ae3de5980dc0" returned: 0 in 0.627s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-6f49b330-42e1-4650-97a4-ae3de5980dc0" released by "delete_volume" :: held 1.424s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['cdb2fbe9-1404-4705-a27b-5629a3f72d8d', '6c9f7772-717b-4cdf-b54b-5bb923dda926', '9f329adb-06b6-4b76-ba5c-39cd902f59c7', '8337fb47-2f7e-475d-9d54-16b30751be8c'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:55 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:55 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:55 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 0.711s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:55 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f Apr 29 18:22:55 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef66f2b-d13f-4332-adb4-40bf74897634]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:55 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.730s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:55 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:55 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleted volume successfully. Apr 29 18:22:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c1274725-6166-4aae-8d47-ec53ba04fd8b tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-6f49b330-42e1-4650-97a4-ae3de5980dc0-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:56 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 Apr 29 18:22:56 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:56 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9" returned: 0 in 0.952s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:56 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9 Apr 29 18:22:56 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:57 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9" returned: 0 in 1.090s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9" released by "delete_volume" :: held 2.105s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['5df6b9f6-fc69-4b85-b847-812b7d8b1773', 'd0729c13-d367-455f-bd33-19c9bf1a3d84', '01930b42-f20f-4530-a400-94860780d7d4', 'e6d4de36-1ac6-4d7f-b48c-538cf277a665'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:22:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:58 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:22:58 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:22:59 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.918s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:22:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleted volume successfully. Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b5d68962-57ca-4370-b0f9-ffb0f5787735 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-2e879ae3-f2f8-4849-83e4-c18c3d69a4f9-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-e3a50235-d094-4d15-9fea-fa71a39c22ec-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-e3a50235-d094-4d15-9fea-fa71a39c22ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-e3a50235-d094-4d15-9fea-fa71a39c22ec" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-e3a50235-d094-4d15-9fea-fa71a39c22ec" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e712fc-fd36-4f45-94c9-c6d51920dd89]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:22:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:22:59 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec Apr 29 18:22:59 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:00 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f" returned: 0 in 5.225s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:00 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a8c095-93cc-4789-b4a8-4f9551bcee73]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:00 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec" returned: 0 in 1.264s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:00 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:00 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec Apr 29 18:23:00 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:00 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:23:00 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:01 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-e3a50235-d094-4d15-9fea-fa71a39c22ec" returned: 0 in 0.550s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-e3a50235-d094-4d15-9fea-fa71a39c22ec" released by "delete_volume" :: held 1.900s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['552eedb3-becd-41db-bd9d-0e4a62a413f0', 'a9cbcd83-06f1-4f7f-8e32-828c72d1daff', '3b5a3235-4261-43ec-8a78-22dec1876768', '66c9174b-8be5-41c7-8e85-4b1104b91f8d'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:01 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:01 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:01 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 0.852s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:23:01 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Converted 1024.00 MB image at 195.93 MB/s Apr 29 18:23:01 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f is being set with open permissions: ugo+rw Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:01 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f Apr 29 18:23:01 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-791c8abb-4597-4b53-adab-fb58cb93ba11-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-791c8abb-4597-4b53-adab-fb58cb93ba11-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-791c8abb-4597-4b53-adab-fb58cb93ba11" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-791c8abb-4597-4b53-adab-fb58cb93ba11" acquired by "delete_volume" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20a950e-addd-4935-878e-7a7743de213e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:01 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:02 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 Apr 29 18:23:02 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:02 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleted volume successfully. Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d792c812-a5ad-4901-ab49-bc0defdbfebe tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-e3a50235-d094-4d15-9fea-fa71a39c22ec-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:02 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f" returned: 0 in 0.635s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-ad53f71c-548a-435c-9c9d-add89154827f" released by "_copy_volume_from_snapshot" :: held 8.218s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-57f8ac10-5168-4a02-ba41-d6d4feb706a7-ad53f71c-548a-435c-9c9d-add89154827f" released by "_create_volume_from_snapshot" :: held 8.263s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.296s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.328s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104158930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a587bc-2a4f-456e-b102-4b8afd5214b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:22:51Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Creating volume 82a587bc-2a4f-456e-b102-4b8afd5214b9 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:02 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:02 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 1073741824 Apr 29 18:23:02 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ed0cfc-6845-4424-9856-22d203f2f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad53f71c-548a-435c-9c9d-add89154827f', 'volume_size': 1, 'snapshot_id': '57f8ac10-5168-4a02-ba41-d6d4feb706a7'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662d0394-68a7-4119-936f-0b786ae91560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:02 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Volume volume-ad53f71c-548a-435c-9c9d-add89154827f (ad53f71c-548a-435c-9c9d-add89154827f): created successfully Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662d0394-68a7-4119-936f-0b786ae91560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (973a04df-5a20-422b-adc1-5ece8404b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:02 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a0240d47-71db-4c60-a50a-1b2da0a05102 tempest-VolumeDependencyTests-1617016056 None] Created volume successfully. Apr 29 18:23:02 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11" returned: 0 in 0.696s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:02 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11 Apr 29 18:23:02 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-57f8ac10-5168-4a02-ba41-d6d4feb706a7-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-57f8ac10-5168-4a02-ba41-d6d4feb706a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-57f8ac10-5168-4a02-ba41-d6d4feb706a7" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-57f8ac10-5168-4a02-ba41-d6d4feb706a7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Deleting offline snapshot 57f8ac10-5168-4a02-ba41-d6d4feb706a7 of volume d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] snapshot_file for this snap is: volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c388ca-d981-44db-8464-c479c127856c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:02 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:03 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 Apr 29 18:23:03 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:03 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 1073741824" returned: 0 in 0.870s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:03 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-791c8abb-4597-4b53-adab-fb58cb93ba11" returned: 0 in 0.670s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-791c8abb-4597-4b53-adab-fb58cb93ba11" released by "delete_volume" :: held 1.414s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:03 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 Apr 29 18:23:03 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['1a111dba-f8df-493e-bc2b-502bd0c40eae', '556174b8-59f3-4d51-99ad-eb86ce8379b0', '15f947a8-e86e-42f9-9bd8-f15af7647679', 'cd36ed01-3e17-4837-8a84-fe2681c567f9'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:03 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:03 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:03 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7" returned: 0 in 0.703s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8648db-115c-4672-8b83-942dad8de0c7]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:03 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:23:03 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:03 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9" returned: 0 in 0.661s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:03 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.537s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Creating offline snapshot 406f8cca-6d23-4efe-bce8-7b393def86e2 of volume 905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebb067f-829c-41ac-9469-b8220116beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a587bc-2a4f-456e-b102-4b8afd5214b9', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:04 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd87412-f445-4e5a-95cc-acba513987cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b8b19-39bf-495c-b779-7a28198b1e9b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.655s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-22181acb-3084-45f4-8328-797279e3c18d-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:04 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 (82a587bc-2a4f-456e-b102-4b8afd5214b9): created successfully Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd87412-f445-4e5a-95cc-acba513987cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (5a064179-991b-495c-84d5-982d708bea66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleted volume successfully. Apr 29 18:23:04 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-69110a8d-3530-4931-90a0-1976134c4142 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created volume successfully. Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-22181acb-3084-45f4-8328-797279e3c18d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-524fe23f-7246-405d-b729-e1e0e1403d17 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-791c8abb-4597-4b53-adab-fb58cb93ba11-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-22181acb-3084-45f4-8328-797279e3c18d" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-22181acb-3084-45f4-8328-797279e3c18d" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:04 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:23:04 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e6fbf-ee20-4a65-b545-adce0e118f60]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:04 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d Apr 29 18:23:04 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:04 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 0.755s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:04 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 Apr 29 18:23:04 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:04 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.775s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:04 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 1G Apr 29 18:23:04 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:04 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d" returned: 0 in 0.733s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:04 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:04 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d Apr 29 18:23:04 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:05 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7" returned: 0 in 0.724s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:05 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7 Apr 29 18:23:05 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:05 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-22181acb-3084-45f4-8328-797279e3c18d" returned: 0 in 0.814s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:05 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (4354a2aa-f2e3-4e5a-900f-eb92a10c32d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75a0fc6-8122-4943-94da-e08a16bb5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-22181acb-3084-45f4-8328-797279e3c18d" released by "delete_volume" :: held 1.633s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 1G" returned: 0 in 1.006s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905b3f31-de66-47c2-92fb-44bf34963211 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75a0fc6-8122-4943-94da-e08a16bb5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-780148955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9da47e-31ff-48a7-9058-0da2a571bf23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:06Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:05 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905b3f31-de66-47c2-92fb-44bf34963211 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 Apr 29 18:23:05 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfee143-1e5d-4dc1-954f-3c048f586bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfee143-1e5d-4dc1-954f-3c048f586bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:05 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645a577-a113-4f4c-87cb-4aaddadc6427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645a577-a113-4f4c-87cb-4aaddadc6427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9da47e-31ff-48a7-9058-0da2a571bf23', 'volume_name': 'volume-4e9da47e-31ff-48a7-9058-0da2a571bf23', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92885438-6e3d-4109-8052-2b3d5b87ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92885438-6e3d-4109-8052-2b3d5b87ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111fccfa-19c3-4e14-b67a-6ce2019dfb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:05 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume 4e9da47e-31ff-48a7-9058-0da2a571bf23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9da47e-31ff-48a7-9058-0da2a571bf23', 'volume_size': 1} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:05 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60.57f8ac10-5168-4a02-ba41-d6d4feb706a7" returned: 0 in 0.786s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-57f8ac10-5168-4a02-ba41-d6d4feb706a7" released by "_delete_snapshot" :: held 3.118s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" released by "delete_snapshot" :: held 3.155s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['987599f1-661f-4036-b878-23e8b91d6362', '159df908-4e4b-4d06-a0a6-949b9e4692f5', '22318dc0-3f2b-4e7f-9459-c0299d101609', '41320fb4-b699-44ef-9f21-98e10873a3f9'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:06 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:06 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Created reservations ['ee6b60fc-de63-4b5b-bd01-b70b1744ae04', '1f79431e-d7f4-470a-a2c4-38a74d4ea827', '2f5ba4ed-f5e7-4b2f-b654-e9cac86222bd', '0e507d75-5866-4519-982f-c726e935d849'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Delete snapshot completed successfully. Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-a8cf2f94-8ae5-40a2-8f45-7ee76d5c3146 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-57f8ac10-5168-4a02-ba41-d6d4feb706a7-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (b9bb8094-a83c-4347-8493-5cccfcaad3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2392431a-ac00-4f33-95f2-e524eda86563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-bc0b0a0c-245f-45dc-971a-99c016fa17b8-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2392431a-ac00-4f33-95f2-e524eda86563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1976805976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce321f03-e3c9-4187-971a-703fbc9c688e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:06Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c69cecc-ed42-4173-87b3-271be3c826fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c69cecc-ed42-4173-87b3-271be3c826fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ceb9aa-3aa4-4c10-b347-f3391993b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ceb9aa-3aa4-4c10-b347-f3391993b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce321f03-e3c9-4187-971a-703fbc9c688e', 'volume_name': 'volume-ce321f03-e3c9-4187-971a-703fbc9c688e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc2f817-609f-438b-9f69-6baf61ea7b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc2f817-609f-438b-9f69-6baf61ea7b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b3cc3c-e5cc-4487-b35a-77b786ba4395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume ce321f03-e3c9-4187-971a-703fbc9c688e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce321f03-e3c9-4187-971a-703fbc9c688e', 'volume_size': 1} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-bc0b0a0c-245f-45dc-971a-99c016fa17b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-65e621b4-5052-44c0-bc77-a2e1744d58c9" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-65e621b4-5052-44c0-bc77-a2e1744d58c9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-bc0b0a0c-245f-45dc-971a-99c016fa17b8" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-bc0b0a0c-245f-45dc-971a-99c016fa17b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleting offline snapshot bc0b0a0c-245f-45dc-971a-99c016fa17b8 of volume 65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] snapshot_file for this snap is: volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c6e1ad-317f-4828-a582-71f5ba90dcb2]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:06 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905b3f31-de66-47c2-92fb-44bf34963211 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2" returned: 0 in 0.829s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:06 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 is being set with open permissions: ugo+rw Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:06 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 Apr 29 18:23:06 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:06 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 Apr 29 18:23:06 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (05f83b66-1457-4dff-ba74-fdcba7623074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:06 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d586208-98f4-41bc-a90e-d455831791ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.833s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:06 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleted volume successfully. Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d586208-98f4-41bc-a90e-d455831791ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1439836595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d2e0ed-1122-4654-ad41-32760e722320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:07Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94880d21-51b6-4330-9fc7-c7688b557a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94880d21-51b6-4330-9fc7-c7688b557a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:06 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98eece8f-4be1-41d6-8831-a9e064060e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98eece8f-4be1-41d6-8831-a9e064060e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d2e0ed-1122-4654-ad41-32760e722320', 'volume_name': 'volume-34d2e0ed-1122-4654-ad41-32760e722320', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147f0b3c-adf4-4887-8505-f8bb626d5e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147f0b3c-adf4-4887-8505-f8bb626d5e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f30e94-75a8-4b42-8eb4-69de4deac411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume 34d2e0ed-1122-4654-ad41-32760e722320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d2e0ed-1122-4654-ad41-32760e722320', 'volume_size': 1} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-fee94f24-7350-46aa-ab01-0fc2ad9f6a97 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-22181acb-3084-45f4-8328-797279e3c18d-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-d9f7245f-fdc1-4964-a1a0-d6716d20ed60-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-d9f7245f-fdc1-4964-a1a0-d6716d20ed60-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc92f0-2cab-4316-b0c0-8959debff0dc]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:07 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2" returned: 0 in 0.761s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:07 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:23:07 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:07 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8" returned: 0 in 0.941s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65e621b4-5052-44c0-bc77-a2e1744d58c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9538234-8dd3-4714-9e93-282749ba1620]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:07 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info Apr 29 18:23:07 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (61d5519e-7710-4a85-8710-0513315fe0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22dc3bc5-0076-46af-8942-dc9e1ae62e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22dc3bc5-0076-46af-8942-dc9e1ae62e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431541986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4778c251-e920-4ea4-80c7-b4696c93545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:07Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8687b2c9-ad27-4767-86e0-9c1b269ddc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8687b2c9-ad27-4767-86e0-9c1b269ddc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44033984-863a-492e-b90f-b4457b1cc164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44033984-863a-492e-b90f-b4457b1cc164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4778c251-e920-4ea4-80c7-b4696c93545b', 'volume_name': 'volume-4778c251-e920-4ea4-80c7-b4696c93545b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37950d68-f026-4543-8938-0d183fceb262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37950d68-f026-4543-8938-0d183fceb262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49117919-b8e7-4cf1-b89e-be4198406915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume 4778c251-e920-4ea4-80c7-b4696c93545b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4778c251-e920-4ea4-80c7-b4696c93545b', 'volume_size': 1} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:07 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 Apr 29 18:23:07 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (17da76f4-47ee-4766-97ff-7ce42de7bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d9d6c1-dd85-4c82-93de-ca958fe694d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d9d6c1-dd85-4c82-93de-ca958fe694d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697311982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a60c620-dbae-48bd-9af5-b1fbebe70cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:08Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ad3cb3-ae79-44e7-8953-d66c132209e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ad3cb3-ae79-44e7-8953-d66c132209e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4458fa27-b9a6-4f34-8940-d94aa9ff8ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4458fa27-b9a6-4f34-8940-d94aa9ff8ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a60c620-dbae-48bd-9af5-b1fbebe70cc2', 'volume_name': 'volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545ab5d7-e62c-4cfb-b5e2-b2719b06b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545ab5d7-e62c-4cfb-b5e2-b2719b06b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6037f960-a46e-4b8f-99b1-baf8597cb2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:07 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume 9a60c620-dbae-48bd-9af5-b1fbebe70cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2', 'volume_size': 1} Apr 29 18:23:07 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:08 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 0.950s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:08 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info" returned: 0 in 0.721s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:08 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info is being set with open permissions: ugo+rw Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:08 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60 Apr 29 18:23:08 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:08 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info Apr 29 18:23:08 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:08 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9" returned: 0 in 0.885s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:08 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 Apr 29 18:23:08 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:08 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" returned: 0 in 0.602s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:08 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.info" returned: 0 in 0.604s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.954s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-d9f7245f-fdc1-4964-a1a0-d6716d20ed60" released by "delete_volume" :: held 1.642s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.043s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-780148955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9da47e-31ff-48a7-9058-0da2a571bf23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:06Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Creating volume 4e9da47e-31ff-48a7-9058-0da2a571bf23 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:08 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:08 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:08 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 1073741824 Apr 29 18:23:08 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:09 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c29142dd-c66d-465f-9906-032ef9988568 tempest-SnapshotDependencyTests-1172365818 None] Create snapshot completed successfully Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Created reservations ['0bf94e4e-0d1d-4f40-ae20-615d0c6fb013', 'afddf35c-5815-4a41-bdd3-ad11196a1590', '019c1f45-6668-4167-a556-701f349b21e6', '2263d9f7-b02f-4e62-b4a2-5ecc26b2ef49'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:09 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:09 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:09 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8" returned: 0 in 0.747s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:09 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:09 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8 Apr 29 18:23:09 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:10 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 1073741824" returned: 0 in 1.047s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:10 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.908s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Deleted volume successfully. Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:10 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9.bc0b0a0c-245f-45dc-971a-99c016fa17b8" returned: 0 in 0.827s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:10 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 Apr 29 18:23:10 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-18c991ac-24cd-4fdb-b5a0-932a4d7891f5 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-d9f7245f-fdc1-4964-a1a0-d6716d20ed60-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-bc0b0a0c-245f-45dc-971a-99c016fa17b8" released by "_delete_snapshot" :: held 3.565s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-65e621b4-5052-44c0-bc77-a2e1744d58c9" released by "delete_snapshot" :: held 3.595s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (96f5e2ef-d2ea-4827-a6f6-a8313e378e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d9c9f3-0958-4d9e-8f68-1d07ee6940e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d9c9f3-0958-4d9e-8f68-1d07ee6940e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1141783061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9058880a-fd20-4744-af58-e5ce9b1334d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7cd9989df244f09f6ec49cfd179e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:10Z,use_quota=True,user_id='267c82a5bab946bf991d031419ee5bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a05a8f3-495d-4d35-9fed-b8ebdc10e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a05a8f3-495d-4d35-9fed-b8ebdc10e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0acb2e5-fd9d-4729-a5fb-37a50ffb7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0acb2e5-fd9d-4729-a5fb-37a50ffb7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9058880a-fd20-4744-af58-e5ce9b1334d4', 'volume_name': 'volume-9058880a-fd20-4744-af58-e5ce9b1334d4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71093f8-9b24-46d0-9dc7-5d86a1614484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71093f8-9b24-46d0-9dc7-5d86a1614484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc77a78-da3d-456d-913a-2dd288f0b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Volume 9058880a-fd20-4744-af58-e5ce9b1334d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9058880a-fd20-4744-af58-e5ce9b1334d4', 'volume_size': 1} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Flow 'volume_create_manager' (e9ae430a-6e45-4917-917f-2202776bb1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5496b4b1-40aa-4b1b-9db9-ec95ac1fbb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5496b4b1-40aa-4b1b-9db9-ec95ac1fbb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee71eaa0-290b-482d-af89-12e8021fd535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce6a51e3b74f7bbac2898ad1416cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=406f8cca-6d23-4efe-bce8-7b393def86e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:10Z,use_quota=True,user_id='fefbc8326bec4e428ca871402f832d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd963d00-faac-4a86-a9a2-53484633ac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd963d00-faac-4a86-a9a2-53484633ac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aa8367-122e-4299-9adf-35451e950754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aa8367-122e-4299-9adf-35451e950754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee71eaa0-290b-482d-af89-12e8021fd535', 'volume_name': 'volume-ee71eaa0-290b-482d-af89-12e8021fd535', 'volume_size': 1, 'snapshot_id': '406f8cca-6d23-4efe-bce8-7b393def86e2'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a094024-4924-4130-9e26-8562bab8efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a094024-4924-4130-9e26-8562bab8efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5839652-9dcd-4f6d-a654-1f5fa5f16a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Volume ee71eaa0-290b-482d-af89-12e8021fd535: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee71eaa0-290b-482d-af89-12e8021fd535', 'volume_size': 1, 'snapshot_id': '406f8cca-6d23-4efe-bce8-7b393def86e2'} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['c7102052-67e3-4dbf-9c25-fabbf13934b9', '147acf5e-16be-48be-aa61-8999821f4782', '176528cc-6360-4bd0-be2e-75c517cf20bd', '2599e7a7-b2ac-4a1f-aa7d-71229ccfe7ab'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Delete snapshot completed successfully. Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-6de73596-2e43-484d-a0ce-8b8e47560a48 tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-bc0b0a0c-245f-45dc-971a-99c016fa17b8-delete_snapshot" released by "delete_snapshot" :: held 3.921s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:10 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23" returned: 0 in 0.607s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.145s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1976805976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce321f03-e3c9-4187-971a-703fbc9c688e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:06Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Creating volume ce321f03-e3c9-4187-971a-703fbc9c688e {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:10 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e 1073741824 Apr 29 18:23:10 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111fccfa-19c3-4e14-b67a-6ce2019dfb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9da47e-31ff-48a7-9058-0da2a571bf23', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60e63df-c5d1-424e-b4b9-3b5be354f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 (4e9da47e-31ff-48a7-9058-0da2a571bf23): created successfully Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60e63df-c5d1-424e-b4b9-3b5be354f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:10 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (4354a2aa-f2e3-4e5a-900f-eb92a10c32d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:10 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-75e92d53-8fd6-4d90-96c9-7ec82240899b tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created volume successfully. Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-65e621b4-5052-44c0-bc77-a2e1744d58c9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-65e621b4-5052-44c0-bc77-a2e1744d58c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "cinder-quobyte-65e621b4-5052-44c0-bc77-a2e1744d58c9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-65e621b4-5052-44c0-bc77-a2e1744d58c9" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fef58b-6daa-43e3-af1c-a155abec3a53]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:11 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 Apr 29 18:23:11 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:11 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e 1073741824" returned: 0 in 0.761s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:11 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e Apr 29 18:23:11 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:11 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9" returned: 0 in 0.696s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:11 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:11 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9 Apr 29 18:23:11 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:12 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e" returned: 0 in 0.597s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.037s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1439836595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d2e0ed-1122-4654-ad41-32760e722320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:07Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Creating volume 34d2e0ed-1122-4654-ad41-32760e722320 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:12 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:12 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 1073741824 Apr 29 18:23:12 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b3cc3c-e5cc-4487-b35a-77b786ba4395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce321f03-e3c9-4187-971a-703fbc9c688e', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323fc112-7de2-4795-9081-15564173f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:12 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume volume-ce321f03-e3c9-4187-971a-703fbc9c688e (ce321f03-e3c9-4187-971a-703fbc9c688e): created successfully Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323fc112-7de2-4795-9081-15564173f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (b9bb8094-a83c-4347-8493-5cccfcaad3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:12 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-69fdfb73-f652-4175-8ac6-4d8b1ec6b073 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created volume successfully. Apr 29 18:23:12 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-65e621b4-5052-44c0-bc77-a2e1744d58c9" returned: 0 in 0.640s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-quobyte-65e621b4-5052-44c0-bc77-a2e1744d58c9" released by "delete_volume" :: held 1.416s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Created reservations ['df01dc01-16ff-4703-8779-9e16586caa7e', '8bffa1f1-440e-4ffc-92b4-66d2e0b1c542', '8f4817c8-c886-44d3-9109-c63e8375e875', 'f04757a5-4171-4eff-92c1-8a961a0141a5'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:12 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:12 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:12 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 1073741824" returned: 0 in 0.863s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:12 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:13 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 Apr 29 18:23:13 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:13 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.634s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:13 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Deleted volume successfully. Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-7abe8355-14ed-4e95-9797-08198722c6af tempest-CreateVolumesFromSnapshotTest-697883746 None] Lock "cinder-65e621b4-5052-44c0-bc77-a2e1744d58c9-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:13 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320" returned: 0 in 0.614s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.828s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431541986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4778c251-e920-4ea4-80c7-b4696c93545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:07Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Creating volume 4778c251-e920-4ea4-80c7-b4696c93545b {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:13 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:13 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b 1073741824 Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f30e94-75a8-4b42-8eb4-69de4deac411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d2e0ed-1122-4654-ad41-32760e722320', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:13 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d71e35c-f055-4d7a-854a-c907b2fb6ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:13 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume volume-34d2e0ed-1122-4654-ad41-32760e722320 (34d2e0ed-1122-4654-ad41-32760e722320): created successfully Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d71e35c-f055-4d7a-854a-c907b2fb6ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:13 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (05f83b66-1457-4dff-ba74-fdcba7623074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:13 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9614b742-3d47-4447-a40e-7bb5eb39b0e5 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created volume successfully. Apr 29 18:23:14 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b 1073741824" returned: 0 in 0.837s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:14 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:14 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b Apr 29 18:23:14 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:15 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b" returned: 0 in 0.668s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.188s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697311982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a60c620-dbae-48bd-9af5-b1fbebe70cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604a4f730be44da498ffa1abf02af80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:08Z,use_quota=True,user_id='38108fa445144a3bbfbfd10ed45b48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Creating volume 9a60c620-dbae-48bd-9af5-b1fbebe70cc2 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:15 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:15 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 1073741824 Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49117919-b8e7-4cf1-b89e-be4198406915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4778c251-e920-4ea4-80c7-b4696c93545b', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:15 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0777bfb-e51e-4d3b-b16c-388f3ad3c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:15 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume volume-4778c251-e920-4ea4-80c7-b4696c93545b (4778c251-e920-4ea4-80c7-b4696c93545b): created successfully Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0777bfb-e51e-4d3b-b16c-388f3ad3c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:15 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (61d5519e-7710-4a85-8710-0513315fe0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:15 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-170dc098-08ab-448d-bcca-9818016da22c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created volume successfully. Apr 29 18:23:16 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 1073741824" returned: 0 in 0.855s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Flow 'volume_create_manager' (0ba4198b-6f73-4c07-b180-b415b13da082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e69a6a-37ae-46fa-8487-0508ccad7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e69a6a-37ae-46fa-8487-0508ccad7597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0c8013-73df-41c2-944c-bf6e99f05927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b942d132789f4eff8ca2d68e9547faaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:16Z,use_quota=True,user_id='2f0ec14d84024bcfb37859c475303328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356a0503-27bd-4818-b696-44d42920159d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:16 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 Apr 29 18:23:16 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356a0503-27bd-4818-b696-44d42920159d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930fb296-0e07-40a0-9fa3-9fced28ec67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930fb296-0e07-40a0-9fa3-9fced28ec67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd0c8013-73df-41c2-944c-bf6e99f05927', 'volume_name': 'volume-dd0c8013-73df-41c2-944c-bf6e99f05927', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6573a5ef-dabb-445d-b855-47b4464dc657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6573a5ef-dabb-445d-b855-47b4464dc657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9253e1e-3479-4510-8dce-bb16af1931f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:16 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Volume dd0c8013-73df-41c2-944c-bf6e99f05927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd0c8013-73df-41c2-944c-bf6e99f05927', 'volume_size': 1} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:16 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2" returned: 0 in 0.575s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.421s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1141783061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9058880a-fd20-4744-af58-e5ce9b1334d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7cd9989df244f09f6ec49cfd179e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:10Z,use_quota=True,user_id='267c82a5bab946bf991d031419ee5bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Creating volume 9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:16 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6037f960-a46e-4b8f-99b1-baf8597cb2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:16 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 1073741824 Apr 29 18:23:16 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ada499-24c4-49b2-8d47-474ea524e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:16 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Volume volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 (9a60c620-dbae-48bd-9af5-b1fbebe70cc2): created successfully Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ada499-24c4-49b2-8d47-474ea524e01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:16 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Flow 'volume_create_manager' (17da76f4-47ee-4766-97ff-7ce42de7bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:16 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-13b3b3ee-67d6-4e38-b4cc-1030eb4b369a tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created volume successfully. Apr 29 18:23:17 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 1073741824" returned: 0 in 0.728s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:17 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:17 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-9a60c620-dbae-48bd-9af5-b1fbebe70cc2-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-9a60c620-dbae-48bd-9af5-b1fbebe70cc2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-quobyte-9a60c620-dbae-48bd-9af5-b1fbebe70cc2" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-9a60c620-dbae-48bd-9af5-b1fbebe70cc2" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc459cb-5f36-410a-a279-c34732d1c856]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:17 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:18 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.667s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-quobyte-406f8cca-6d23-4efe-bce8-7b393def86e2-ee71eaa0-290b-482d-af89-12e8021fd535" by "_create_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:18 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 Apr 29 18:23:18 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc77a78-da3d-456d-913a-2dd288f0b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9058880a-fd20-4744-af58-e5ce9b1334d4', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa6ab07-e66f-4699-a3a1-7476a30ddb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-406f8cca-6d23-4efe-bce8-7b393def86e2-ee71eaa0-290b-482d-af89-12e8021fd535" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Creating volume ee71eaa0-290b-482d-af89-12e8021fd535 from snapshot 406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-quobyte-ee71eaa0-290b-482d-af89-12e8021fd535" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-ee71eaa0-290b-482d-af89-12e8021fd535" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] snapshot: 406f8cca-6d23-4efe-bce8-7b393def86e2, volume: ee71eaa0-290b-482d-af89-12e8021fd535, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:23:18 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Volume volume-9058880a-fd20-4744-af58-e5ce9b1334d4 (9058880a-fd20-4744-af58-e5ce9b1334d4): created successfully Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa6ab07-e66f-4699-a3a1-7476a30ddb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (96f5e2ef-d2ea-4827-a6f6-a8313e378e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:18 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d9aa0637-220c-4362-9e66-38674c60e122 tempest-VolumeDependencyTests-1617016056 None] Created volume successfully. Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07e1d2-398a-477a-a75e-7616bad5c509]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:18 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 Apr 29 18:23:18 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:18 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2" returned: 0 in 0.761s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:18 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2 Apr 29 18:23:18 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:18 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2" returned: 0 in 0.763s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905b3f31-de66-47c2-92fb-44bf34963211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:23:18 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68f161-2129-4961-b470-c22b91b87d0b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (4256e1dd-910f-49ed-aacf-1d2c98eda678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f28aaba-017e-4a2e-869d-daa3f22f350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f28aaba-017e-4a2e-869d-daa3f22f350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-835815985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d25db0f-1752-4fee-8d82-e1eea6fdbbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7cd9989df244f09f6ec49cfd179e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9058880a-fd20-4744-af58-e5ce9b1334d4,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:19Z,use_quota=True,user_id='267c82a5bab946bf991d031419ee5bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d43885-e6ae-4868-a84c-8a51b93e3463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:19 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:23:19 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d43885-e6ae-4868-a84c-8a51b93e3463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba5ed6-0d34-4187-8767-8aa2d87ed49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba5ed6-0d34-4187-8767-8aa2d87ed49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d25db0f-1752-4fee-8d82-e1eea6fdbbeb', 'volume_name': 'volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb', 'volume_size': 1, 'source_volid': '9058880a-fd20-4744-af58-e5ce9b1334d4', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5127a51c-10b9-4780-822e-8db9206ad610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5127a51c-10b9-4780-822e-8db9206ad610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816b0363-02ab-494c-9d92-372ec5ca3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:19 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Volume 2d25db0f-1752-4fee-8d82-e1eea6fdbbeb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb', 'volume_size': 1, 'source_volid': '9058880a-fd20-4744-af58-e5ce9b1334d4', 'source_volstatus': 'available'} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:19 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9a60c620-dbae-48bd-9af5-b1fbebe70cc2" returned: 0 in 0.618s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-9a60c620-dbae-48bd-9af5-b1fbebe70cc2" released by "delete_volume" :: held 1.419s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created reservations ['fb34adc9-b3ae-46f3-8e35-23385dbda7dc', 'd7d560b5-0cb7-453c-9c27-0095b2f16fb0', '8584e6fa-c35c-477c-a902-db0d98ccec48', 'a3d9ad1b-7bbf-47ec-b786-1c5d10cb544d'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:19 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:19 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:19 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.704s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:23:19 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:19 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 Apr 29 18:23:19 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:20 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.598s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:20 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Deleted volume successfully. Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-4778c251-e920-4ea4-80c7-b4696c93545b-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-4778c251-e920-4ea4-80c7-b4696c93545b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c3177e20-05a5-4f0b-84d9-7628d4ac6a17 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-9a60c620-dbae-48bd-9af5-b1fbebe70cc2-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-quobyte-4778c251-e920-4ea4-80c7-b4696c93545b" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-4778c251-e920-4ea4-80c7-b4696c93545b" acquired by "delete_volume" :: waited 0.015s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c145d24-cf40-460b-a7ed-f773ce7ee1ff]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:20 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:20 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b Apr 29 18:23:20 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:21 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b" returned: 0 in 1.247s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:21 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:21 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b Apr 29 18:23:21 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:22 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:22 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4778c251-e920-4ea4-80c7-b4696c93545b" returned: 0 in 1.229s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:22 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-4778c251-e920-4ea4-80c7-b4696c93545b" released by "delete_volume" :: held 2.538s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:22 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=141,cinder:UPDATE=186,cinder:INSERT=40,cinder:DELETE=17 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:23:22 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=182,cinder:SELECT=134,cinder:INSERT=43,cinder:DELETE=20 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:23:22 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created reservations ['56cbc4ae-c6a5-4259-8e29-04645723994e', 'b0ad89c5-d396-4bba-a4f2-a0f23ea48c5e', '0a8c9ea7-ec6b-40f3-a334-fa4691a049a4', '9892c73a-a8ee-422f-bc9d-f9b2882cb3b3'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:23 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:23 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-34d2e0ed-1122-4654-ad41-32760e722320-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-34d2e0ed-1122-4654-ad41-32760e722320-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-quobyte-34d2e0ed-1122-4654-ad41-32760e722320" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-34d2e0ed-1122-4654-ad41-32760e722320" acquired by "delete_volume" :: waited 0.026s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e53591-bea2-486d-b758-84243610cf4e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:23 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:24 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 Apr 29 18:23:24 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:24 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:24 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.677s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:24 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:24 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Deleted volume successfully. Apr 29 18:23:24 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e18ab8c5-b925-47c3-81d9-7f0dac11b34c tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-4778c251-e920-4ea4-80c7-b4696c93545b-delete_volume" released by "delete_volume" :: held 4.662s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:25 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535" returned: 0 in 5.379s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e3e1bc-0ab3-4e8d-8114-1a739930f615]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:25 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320" returned: 0 in 1.302s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:25 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320 Apr 29 18:23:25 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:25 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:23:25 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:25 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-34d2e0ed-1122-4654-ad41-32760e722320" returned: 0 in 0.582s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-34d2e0ed-1122-4654-ad41-32760e722320" released by "delete_volume" :: held 1.981s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created reservations ['a08cd8bc-2a46-4cd7-b70f-77bb4d313591', 'c354475d-194a-41b5-a592-1b0f1131c023', 'aed31936-7722-4206-83ae-6b2e040d4319', '926cab3c-8188-4181-8c1b-bd28ee3749ed'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:25 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:25 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:25 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:26 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.900s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:23:26 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Converted 1024.00 MB image at 190.34 MB/s Apr 29 18:23:26 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 is being set with open permissions: ugo+rw Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:26 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 Apr 29 18:23:26 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-ce321f03-e3c9-4187-971a-703fbc9c688e-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-ce321f03-e3c9-4187-971a-703fbc9c688e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-quobyte-ce321f03-e3c9-4187-971a-703fbc9c688e" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-ce321f03-e3c9-4187-971a-703fbc9c688e" acquired by "delete_volume" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f5ee22-0b67-4105-9115-3e992d2f0453]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:26 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e Apr 29 18:23:26 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:26 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.676s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Deleted volume successfully. Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-23e0f7a2-a074-40f7-b60f-31a43fe307a7 tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-34d2e0ed-1122-4654-ad41-32760e722320-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:26 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535" returned: 0 in 0.628s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-ee71eaa0-290b-482d-af89-12e8021fd535" released by "_copy_volume_from_snapshot" :: held 8.510s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-406f8cca-6d23-4efe-bce8-7b393def86e2-ee71eaa0-290b-482d-af89-12e8021fd535" released by "_create_volume_from_snapshot" :: held 8.551s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.586s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.519s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0c8013-73df-41c2-944c-bf6e99f05927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b942d132789f4eff8ca2d68e9547faaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:16Z,use_quota=True,user_id='2f0ec14d84024bcfb37859c475303328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Creating volume dd0c8013-73df-41c2-944c-bf6e99f05927 {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:26 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:26 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 1073741824 Apr 29 18:23:26 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5839652-9dcd-4f6d-a654-1f5fa5f16a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee71eaa0-290b-482d-af89-12e8021fd535', 'volume_size': 1, 'snapshot_id': '406f8cca-6d23-4efe-bce8-7b393def86e2'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8f046-ef7a-4eda-9620-83e37a06e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:26 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Volume volume-ee71eaa0-290b-482d-af89-12e8021fd535 (ee71eaa0-290b-482d-af89-12e8021fd535): created successfully Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8f046-ef7a-4eda-9620-83e37a06e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Flow 'volume_create_manager' (e9ae430a-6e45-4917-917f-2202776bb1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:26 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-8c447e93-07ab-42e0-90a6-a97a43a2e356 tempest-SnapshotDependencyTests-1172365818 None] Created volume successfully. Apr 29 18:23:26 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e" returned: 0 in 0.754s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:26 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:26 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e Apr 29 18:23:26 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:27 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 1073741824" returned: 0 in 0.773s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:27 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 Apr 29 18:23:27 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:27 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ce321f03-e3c9-4187-971a-703fbc9c688e" returned: 0 in 0.609s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-ce321f03-e3c9-4187-971a-703fbc9c688e" released by "delete_volume" :: held 1.407s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created reservations ['df9c9bfc-3e53-4ff4-b864-a59c870e0d55', '0108eb5a-d375-4948-b055-09dfe7cf4a61', '657dff8c-da6c-431f-9af4-cd7d9ee52032', 'ba24ce12-09f4-4df1-bf95-7e72134b219a'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-406f8cca-6d23-4efe-bce8-7b393def86e2-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-406f8cca-6d23-4efe-bce8-7b393def86e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-quobyte-905b3f31-de66-47c2-92fb-44bf34963211" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-905b3f31-de66-47c2-92fb-44bf34963211" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-quobyte-406f8cca-6d23-4efe-bce8-7b393def86e2" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-406f8cca-6d23-4efe-bce8-7b393def86e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Deleting offline snapshot 406f8cca-6d23-4efe-bce8-7b393def86e2 of volume 905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:23:27 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:27 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] snapshot_file for this snap is: volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d416e7-3b85-4654-bc44-0b504fd709f2]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:27 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:27 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 Apr 29 18:23:27 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:28 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927" returned: 0 in 0.675s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.013s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:28 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Cloning volume 9058880a-fd20-4744-af58-e5ce9b1334d4 to volume 2d25db0f-1752-4fee-8d82-e1eea6fdbbeb Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9253e1e-3479-4510-8dce-bb16af1931f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd0c8013-73df-41c2-944c-bf6e99f05927', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e14681-f1dc-4c42-8927-dd7a5c8d6d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:28 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Volume volume-dd0c8013-73df-41c2-944c-bf6e99f05927 (dd0c8013-73df-41c2-944c-bf6e99f05927): created successfully Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e14681-f1dc-4c42-8927-dd7a5c8d6d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Flow 'volume_create_manager' (0ba4198b-6f73-4c07-b180-b415b13da082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Creating offline snapshot f7ffe449-1099-4c16-8b2f-a54386db7174 of volume 9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:23:28 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-04bc76e3-b83e-435d-8ee5-826f2a8ec2f5 tempest-CinderUnicodeTest-1427111057 None] Created volume successfully. Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72ec12-52cf-45be-b5b5-a5c3fa297972]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-4e9da47e-31ff-48a7-9058-0da2a571bf23-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:28 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-4e9da47e-31ff-48a7-9058-0da2a571bf23-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.662s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:28 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Deleted volume successfully. Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2fce89d8-2e54-4fae-bcd2-c74950decddc tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-ce321f03-e3c9-4187-971a-703fbc9c688e-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-quobyte-4e9da47e-31ff-48a7-9058-0da2a571bf23" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-4e9da47e-31ff-48a7-9058-0da2a571bf23" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:28 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:28 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d1dff2-1c7a-4019-9eb6-c87a820b5f1b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:28 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2" returned: 0 in 0.786s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905b3f31-de66-47c2-92fb-44bf34963211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:28 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 Apr 29 18:23:28 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[be33d2bc-818b-4ff1-b824-75b876f8e45c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:28 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:28 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:23:28 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:29 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.829s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:29 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 1G Apr 29 18:23:29 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:29 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23" returned: 0 in 0.782s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:29 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23 Apr 29 18:23:29 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:29 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.747s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:29 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 Apr 29 18:23:29 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84402) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Flow 'volume_create_manager' (a812978e-476c-4ef7-945e-1c01d6841cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550c5d76-526b-46e3-8306-d9e1207f3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550c5d76-526b-46e3-8306-d9e1207f3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-11635901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455033f8-df71-472a-ab6a-5409648f2d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b942d132789f4eff8ca2d68e9547faaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:30Z,use_quota=True,user_id='2f0ec14d84024bcfb37859c475303328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b718a9f-5527-4131-90f1-2cd5154c6c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b718a9f-5527-4131-90f1-2cd5154c6c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376a56cc-97a2-448d-b3ae-26df4e713062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376a56cc-97a2-448d-b3ae-26df4e713062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '455033f8-df71-472a-ab6a-5409648f2d6d', 'volume_name': 'volume-455033f8-df71-472a-ab6a-5409648f2d6d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3a7b0a-4c4d-4fea-bde0-4d7cc4e81aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3a7b0a-4c4d-4fea-bde0-4d7cc4e81aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff50ccdd-9bca-4dc4-8180-ef51088626a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:29 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Volume 455033f8-df71-472a-ab6a-5409648f2d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-455033f8-df71-472a-ab6a-5409648f2d6d', 'volume_size': 1} Apr 29 18:23:29 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:30 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-4e9da47e-31ff-48a7-9058-0da2a571bf23" returned: 0 in 0.750s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-4e9da47e-31ff-48a7-9058-0da2a571bf23" released by "delete_volume" :: held 1.579s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:30 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 1G" returned: 0 in 0.950s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9058880a-fd20-4744-af58-e5ce9b1334d4 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created reservations ['c1a70b45-48f0-4908-be8d-b99785f7c9e9', '689dd77f-f6b5-4fd6-a2b4-041e500fe7c7', 'f89b8ce8-cd9b-436d-9356-0559d049544d', '5e314665-0051-4293-baf3-3886502c51b5'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:30 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9058880a-fd20-4744-af58-e5ce9b1334d4 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 Apr 29 18:23:30 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:30 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2" returned: 0 in 0.822s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:30 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:30 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:30 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2 Apr 29 18:23:30 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-82a587bc-2a4f-456e-b102-4b8afd5214b9-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-82a587bc-2a4f-456e-b102-4b8afd5214b9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "cinder-quobyte-82a587bc-2a4f-456e-b102-4b8afd5214b9" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-82a587bc-2a4f-456e-b102-4b8afd5214b9" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:30 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.645s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:30 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Deleted volume successfully. Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326c141-817f-4116-81a7-b7901de5f762]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:30 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9058880a-fd20-4744-af58-e5ce9b1334d4 -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174" returned: 0 in 0.779s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:30 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 is being set with open permissions: ugo+rw Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:30 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211.406f8cca-6d23-4efe-bce8-7b393def86e2" returned: 0 in 0.702s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-e90313be-7334-4b5a-991b-e9419e027a9e tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-4e9da47e-31ff-48a7-9058-0da2a571bf23-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:30 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 Apr 29 18:23:30 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-406f8cca-6d23-4efe-bce8-7b393def86e2" released by "_delete_snapshot" :: held 3.171s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:30 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-905b3f31-de66-47c2-92fb-44bf34963211" released by "delete_snapshot" :: held 3.201s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:30 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 Apr 29 18:23:30 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Created reservations ['a9a07f85-6d45-4083-8d03-7e5f2ab57436', 'fb374902-19e5-429a-bef0-aae95b001cce', '14a1a97b-682d-4491-95c9-97d6b9b0018d', '69c6de6f-012d-4b13-a099-9a52d66d1c46'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:31 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Delete snapshot completed successfully. Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-f309dbc6-0b68-426d-a59a-3286d9c17afa tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-406f8cca-6d23-4efe-bce8-7b393def86e2-delete_snapshot" released by "delete_snapshot" :: held 3.371s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:31 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174" returned: 0 in 0.656s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:31 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info Apr 29 18:23:31 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:31 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9" returned: 0 in 0.790s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:31 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9 Apr 29 18:23:31 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-905b3f31-de66-47c2-92fb-44bf34963211-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:31 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-905b3f31-de66-47c2-92fb-44bf34963211-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-quobyte-905b3f31-de66-47c2-92fb-44bf34963211" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-905b3f31-de66-47c2-92fb-44bf34963211" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6809d648-5083-4bd9-81ac-822e9e0c5a79]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:32 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:23:32 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:32 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info" returned: 0 in 0.688s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:32 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info is being set with open permissions: ugo+rw Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:32 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info Apr 29 18:23:32 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:32 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-82a587bc-2a4f-456e-b102-4b8afd5214b9" returned: 0 in 0.720s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-quobyte-82a587bc-2a4f-456e-b102-4b8afd5214b9" released by "delete_volume" :: held 1.586s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Created reservations ['eeaa8dbf-a550-4d50-8c2f-be6801d3fe5d', '8f286ba6-c53a-416f-9c78-78a251f2a913', 'bec77ce7-0b82-41b5-a112-2d5b1d9aed42', '8732cfb7-15fd-47ae-8d8f-7a14ea326a93'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:32 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:32 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:32 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:32 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.825s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.info" returned: 0 in 0.699s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:32 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211 Apr 29 18:23:32 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:32 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" by "_copy_volume_from_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] snapshot: f7ffe449-1099-4c16-8b2f-a54386db7174, volume: 2d25db0f-1752-4fee-8d82-e1eea6fdbbeb, {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[88465dd9-ddf2-4a24-8c8b-c875cc9574cf]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:33 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.732s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:33 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Deleted volume successfully. Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-0ca6be39-e7dd-4dda-af73-4d51564a777d tempest-CreateVolumesFromSourceVolumeTest-1374745266 None] Lock "cinder-82a587bc-2a4f-456e-b102-4b8afd5214b9-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:33 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 Apr 29 18:23:33 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:33 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-905b3f31-de66-47c2-92fb-44bf34963211" returned: 0 in 0.730s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-905b3f31-de66-47c2-92fb-44bf34963211" released by "delete_volume" :: held 1.627s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Created reservations ['966b1f9c-f5f6-47ef-884f-febb872a8991', 'ee64c398-ea29-40e7-8ac8-7dbe64414def', 'b244d49e-7983-41f0-b32e-2af68bc827cf', 'f79bff56-df44-4ed8-8016-10b52853f04a'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:33 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:33 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:33 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174" returned: 0 in 0.905s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9058880a-fd20-4744-af58-e5ce9b1334d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Creating direct copy from snapshot {{(pid=84402) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 18:23:33 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f6c6e5-c111-4325-a09c-35d2207e7190]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:34 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:34 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-ee71eaa0-290b-482d-af89-12e8021fd535-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-ee71eaa0-290b-482d-af89-12e8021fd535-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "cinder-quobyte-ee71eaa0-290b-482d-af89-12e8021fd535" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-ee71eaa0-290b-482d-af89-12e8021fd535" acquired by "delete_volume" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca8d54a-f53e-485b-9b30-58707be6d0df]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:34 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.726s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:34 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Deleted volume successfully. Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-5b904ca4-a9d6-4f2d-9ff0-bd633fc00e58 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-905b3f31-de66-47c2-92fb-44bf34963211-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:34 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 Apr 29 18:23:34 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:34 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.861s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG cinder.utils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Path /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb not found in is_blk_device check {{(pid=84402) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 18:23:34 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:34 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb Apr 29 18:23:34 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:35 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535" returned: 0 in 0.813s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:35 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535 Apr 29 18:23:35 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_service.periodic_task [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84402) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:35 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:35 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:35 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:36 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ee71eaa0-290b-482d-af89-12e8021fd535" returned: 0 in 0.992s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-quobyte-ee71eaa0-290b-482d-af89-12e8021fd535" released by "delete_volume" :: held 1.872s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Created reservations ['46be7d62-7fad-4c9a-949c-b33189312c69', 'da7c8409-00aa-4744-a459-ccd8ca0a81a0', '471e6b61-1996-4a4b-8055-abbcc3985e34', '21421014-3d34-4569-ac91-34cb9e127fd8'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:36 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:36 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:36 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:37 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:37 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.671s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:37 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d1f65a8f-86ac-4fc1-8f75-c66c963aeeec None None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:38 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:38 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 1.858s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:38 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:38 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Deleted volume successfully. Apr 29 18:23:38 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-73eb132a-835e-4117-babf-fe9d72f7b525 tempest-SnapshotDependencyTests-1172365818 None] Lock "cinder-ee71eaa0-290b-482d-af89-12e8021fd535-delete_volume" released by "delete_volume" :: held 4.255s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:40 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" returned: 0 in 5.185s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:40 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c2222c-925a-4621-9cdf-458f1bac02a2]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:40 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:40 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:40 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.844s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:40 devstack cinder-volume[84402]: DEBUG cinder.image.image_utils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Image conversion details: src /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb {{(pid=84402) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:23:40 devstack cinder-volume[84402]: INFO cinder.image.image_utils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Converted 1024.00 MB image at 197.43 MB/s Apr 29 18:23:40 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb is being set with open permissions: ugo+rw Apr 29 18:23:40 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:40 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb Apr 29 18:23:40 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:41 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" returned: 0 in 0.602s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" released by "_copy_volume_from_snapshot" :: held 8.523s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-f7ffe449-1099-4c16-8b2f-a54386db7174" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-f7ffe449-1099-4c16-8b2f-a54386db7174" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Deleting offline snapshot f7ffe449-1099-4c16-8b2f-a54386db7174 of volume 9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] snapshot_file for this snap is: volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d503156-36b1-4ad3-8c5d-8f2e68329e7b]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:41 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:41 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 Apr 29 18:23:41 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:42 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174" returned: 0 in 0.709s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:42 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9058880a-fd20-4744-af58-e5ce9b1334d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:42 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dce098c-77b1-47c7-96e5-950f9ee90a7c]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:42 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:42 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:42 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:43 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.783s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:43 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 Apr 29 18:23:43 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:43 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174" returned: 0 in 0.720s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:43 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:43 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174 Apr 29 18:23:43 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:44 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4.f7ffe449-1099-4c16-8b2f-a54386db7174" returned: 0 in 0.616s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-f7ffe449-1099-4c16-8b2f-a54386db7174" released by "_delete_snapshot" :: held 2.927s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.345s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.661s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:23:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-11635901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455033f8-df71-472a-ab6a-5409648f2d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b942d132789f4eff8ca2d68e9547faaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:23:30Z,use_quota=True,user_id='2f0ec14d84024bcfb37859c475303328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a59f57d5-49f0-4142-8a0a-74452995e86f),volume_type_id=a59f57d5-49f0-4142-8a0a-74452995e86f)}" {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Creating volume 455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Selected osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 as target Quobyte volume. {{(pid=84402) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:23:44 devstack cinder-volume[84402]: INFO cinder.volume.drivers.remotefs [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] casted to osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61 Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d 1073741824 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:44 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d 1073741824 Apr 29 18:23:44 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816b0363-02ab-494c-9d92-372ec5ca3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb', 'volume_size': 1, 'source_volid': '9058880a-fd20-4744-af58-e5ce9b1334d4', 'source_volstatus': 'available'}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f76613-232d-4cf5-98e1-b21d317f794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:44 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Volume volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb (2d25db0f-1752-4fee-8d82-e1eea6fdbbeb): created successfully Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f76613-232d-4cf5-98e1-b21d317f794f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:44 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Flow 'volume_create_manager' (4256e1dd-910f-49ed-aacf-1d2c98eda678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:44 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-c560e712-9413-4fc7-8f5b-f749472ee77a tempest-VolumeDependencyTests-1617016056 None] Created volume successfully. Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-9058880a-fd20-4744-af58-e5ce9b1334d4-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-9058880a-fd20-4744-af58-e5ce9b1334d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-9058880a-fd20-4744-af58-e5ce9b1334d4" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-9058880a-fd20-4744-af58-e5ce9b1334d4" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:45 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d 1073741824" returned: 0 in 0.936s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[50941bfb-5331-4ba3-b5df-19752d88314a]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:45 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:45 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d Apr 29 18:23:45 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:45 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:45 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:46 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d" returned: 0 in 0.624s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'} {{(pid=84402) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff50ccdd-9bca-4dc4-8180-ef51088626a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455033f8-df71-472a-ab6a-5409648f2d6d', 'volume_size': 1}' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16efd9a3-178b-4470-93a7-e63ff920789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:23:46 devstack cinder-volume[84402]: INFO cinder.volume.flows.manager.create_volume [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Volume volume-455033f8-df71-472a-ab6a-5409648f2d6d (455033f8-df71-472a-ab6a-5409648f2d6d): created successfully Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16efd9a3-178b-4470-93a7-e63ff920789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84402) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Flow 'volume_create_manager' (a812978e-476c-4ef7-945e-1c01d6841cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84402) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:23:46 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-5f002ef1-af01-4f79-897c-949b34140d0f tempest-CinderUnicodeTest-1427111057 None] Created volume successfully. Apr 29 18:23:46 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.778s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:46 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4 Apr 29 18:23:46 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:46 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-9058880a-fd20-4744-af58-e5ce9b1334d4" returned: 0 in 0.583s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-9058880a-fd20-4744-af58-e5ce9b1334d4" released by "delete_volume" :: held 1.443s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:46 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Created reservations ['c780e193-9e26-4981-b44f-47b517a2a21e', '0767c6b7-5a9a-401b-800c-b849a1377d94', 'df46ea7c-7af4-4510-abf1-4dc33ceb38a9', '13589c35-fbbc-4dd1-bdd0-36546a6ecdd7'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:47 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:47 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Creating offline snapshot 44ce51f3-57c6-4b42-8b37-72316899a84e of volume 455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c6f18e-21a4-4a4c-8152-37e55ae6e09e]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:47 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.691s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:47 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Deleted volume successfully. Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" acquired by "delete_volume" :: waited 0.031s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:47 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d Apr 29 18:23:47 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-9b1c33e4-90ec-46f0-845d-64110ef03c11 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-9058880a-fd20-4744-af58-e5ce9b1334d4-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057ec0e-ed61-4bb7-9696-1795c9f94dbf]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:47 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:47 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb Apr 29 18:23:47 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:48 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d" returned: 0 in 0.729s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e 1G {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:48 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e 1G Apr 29 18:23:48 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:48 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" returned: 0 in 0.690s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:48 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:48 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb Apr 29 18:23:48 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:49 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e 1G" returned: 0 in 0.732s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455033f8-df71-472a-ab6a-5409648f2d6d -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:49 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455033f8-df71-472a-ab6a-5409648f2d6d -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e Apr 29 18:23:49 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:49 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" returned: 0 in 0.652s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb" released by "delete_volume" :: held 1.385s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Created reservations ['89120218-8e03-4148-91db-a53d9d8c4b89', 'bfa7e2f3-a3e1-472a-a39f-44915f71ef47', '9b16489a-e0cb-4feb-96ae-447940892f4a', '78397718-1053-43f8-8c21-e6fd80285bea'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:49 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:49 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:49 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455033f8-df71-472a-ab6a-5409648f2d6d -F qcow2 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e" returned: 0 in 0.614s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:49 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e is being set with open permissions: ugo+rw Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:49 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e Apr 29 18:23:49 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:49 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.642s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:49 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Deleted volume successfully. Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1aa876a-088b-4718-b850-15f25b4bcf9f tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-2d25db0f-1752-4fee-8d82-e1eea6fdbbeb-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-ad53f71c-548a-435c-9c9d-add89154827f-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:49 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-ad53f71c-548a-435c-9c9d-add89154827f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "cinder-quobyte-ad53f71c-548a-435c-9c9d-add89154827f" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-ad53f71c-548a-435c-9c9d-add89154827f" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[2686c1da-0a12-4d8a-8537-68b39d9894fd]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:50 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f Apr 29 18:23:50 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:50 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e" returned: 0 in 0.605s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:50 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info Apr 29 18:23:50 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:50 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f" returned: 0 in 0.698s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:50 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f Apr 29 18:23:50 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:50 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info" returned: 0 in 0.576s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:50 devstack cinder-volume[84402]: WARNING cinder.volume.drivers.remotefs [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info is being set with open permissions: ugo+rw Apr 29 18:23:50 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:50 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info Apr 29 18:23:50 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:51 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-ad53f71c-548a-435c-9c9d-add89154827f" returned: 0 in 0.577s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-quobyte-ad53f71c-548a-435c-9c9d-add89154827f" released by "delete_volume" :: held 1.320s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Created reservations ['7bf9156a-170b-4b91-b101-704e88b3fe54', '6ff9dde0-4200-467e-8170-58de5d297284', '9b8feb01-f532-4bd6-b8ee-8c4adfa805bc', 'f6d08ed4-e6ec-4446-a5e7-974e3db48550'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:51 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:51 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:51 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.info" returned: 0 in 0.585s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.949s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:51 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-dd411590-9c62-4866-8be8-1480d27588cd tempest-CinderUnicodeTest-1427111057 None] Create snapshot completed successfully Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-44ce51f3-57c6-4b42-8b37-72316899a84e-delete_snapshot" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-44ce51f3-57c6-4b42-8b37-72316899a84e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-quobyte-455033f8-df71-472a-ab6a-5409648f2d6d" by "delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-455033f8-df71-472a-ab6a-5409648f2d6d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-quobyte-44ce51f3-57c6-4b42-8b37-72316899a84e" by "_delete_snapshot" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-44ce51f3-57c6-4b42-8b37-72316899a84e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Deleting offline snapshot 44ce51f3-57c6-4b42-8b37-72316899a84e of volume 455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] snapshot_file for this snap is: volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e {{(pid=84402) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da19cd-59e7-4b29-88df-0192e937d2db]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:51 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:51 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e Apr 29 18:23:51 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:52 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.625s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:52 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Deleted volume successfully. Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-2cd88630-3d1b-4560-9d36-55d8a89b4c96 tempest-VolumeDependencyTests-1617016056 None] Lock "cinder-ad53f71c-548a-435c-9c9d-add89154827f-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:52 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e" returned: 0 in 0.719s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.remotefs [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-455033f8-df71-472a-ab6a-5409648f2d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84402) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2e19f-93db-4f61-aad9-84dc12b0c5f7]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:52 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:52 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d Apr 29 18:23:52 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:53 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d" returned: 0 in 0.717s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:53 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:53 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e Apr 29 18:23:53 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:54 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e" returned: 0 in 0.692s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:54 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e Apr 29 18:23:54 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:54 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d.44ce51f3-57c6-4b42-8b37-72316899a84e" returned: 0 in 0.551s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-44ce51f3-57c6-4b42-8b37-72316899a84e" released by "_delete_snapshot" :: held 2.784s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-455033f8-df71-472a-ab6a-5409648f2d6d" released by "delete_snapshot" :: held 2.817s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Created reservations ['9467b377-6168-4261-b8f9-b4a7edd5d638', 'fcd948a3-1959-48a9-bad8-cfd67085bcbc', 'a0ab866b-5352-44cc-a99c-10e52bba71bc', 'bedc0e27-7a89-4014-9f73-5eb48b9b64ee'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:54 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Delete snapshot completed successfully. Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-96d82943-64c1-4b30-81b3-a85e0ec262ef tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-44ce51f3-57c6-4b42-8b37-72316899a84e-delete_snapshot" released by "delete_snapshot" :: held 2.937s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:54 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-455033f8-df71-472a-ab6a-5409648f2d6d-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-455033f8-df71-472a-ab6a-5409648f2d6d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-quobyte-455033f8-df71-472a-ab6a-5409648f2d6d" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-455033f8-df71-472a-ab6a-5409648f2d6d" acquired by "delete_volume" :: waited 0.014s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d876e71-ee39-492e-a648-8e8cad2815ef]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:55 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d Apr 29 18:23:55 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:55 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d" returned: 0 in 0.677s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:55 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:55 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d Apr 29 18:23:55 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:56 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-455033f8-df71-472a-ab6a-5409648f2d6d" returned: 0 in 0.564s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-455033f8-df71-472a-ab6a-5409648f2d6d" released by "delete_volume" :: held 1.297s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Created reservations ['e6202041-89ff-4556-b0f2-19b49ee6d2b8', 'de4327e6-5e83-4be5-a4d4-782b3b1ee817', 'b4903994-491f-45f0-a9a1-bce61955336d', '6199613d-d75d-4314-af8a-21d494ca6df1'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:56 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:56 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:56 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:56 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.558s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:57 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Deleted volume successfully. Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-d30604c4-ac59-4399-ab0f-dfb577c8b893 tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-455033f8-df71-472a-ab6a-5409648f2d6d-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-dd0c8013-73df-41c2-944c-bf6e99f05927-delete_volume" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-dd0c8013-73df-41c2-944c-bf6e99f05927-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "cinder-quobyte-dd0c8013-73df-41c2-944c-bf6e99f05927" by "delete_volume" {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-dd0c8013-73df-41c2-944c-bf6e99f05927" acquired by "delete_volume" :: waited 0.013s {{(pid=84402) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af1ad72-f9aa-4275-9b47-8b0bbdc4efe6]: (4, 'qcow2') {{(pid=85639) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:57 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 Apr 29 18:23:57 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:57 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927" returned: 0 in 0.679s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:57 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:57 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927 Apr 29 18:23:57 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:58 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090/volume-dd0c8013-73df-41c2-944c-bf6e99f05927" returned: 0 in 0.573s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-quobyte-dd0c8013-73df-41c2-944c-bf6e99f05927" released by "delete_volume" :: held 1.286s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG cinder.quota [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Created reservations ['387f70ff-3e5e-4599-bb1d-f61bc94237b8', 'ff48288c-a151-4c79-872b-94f5c5f93122', '9494247b-a927-4671-9ee4-acc6b8f0df07', 'a32a3abf-aa21-433e-9cc8-05ed5566f2d2'] {{(pid=84402) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61': None} {{(pid=84402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG cinder.volume.drivers.quobyte [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d849974a-535c-4c22-b272-79524e2b3a61'] {{(pid=84402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.lockutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:23:58 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:23:58 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090 Apr 29 18:23:58 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:23:59 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Apr 29 18:23:59 devstack cinder-volume[84402]: DEBUG oslo_concurrency.processutils [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/00c7cd43112cb791fd16e0a7c16f9090" returned: 0 in 0.561s {{(pid=84402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:23:59 devstack cinder-volume[84402]: DEBUG cinder.manager [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Notifying Schedulers of capabilities ... {{(pid=84402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:23:59 devstack cinder-volume[84402]: INFO cinder.volume.manager [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Deleted volume successfully. Apr 29 18:23:59 devstack cinder-volume[84402]: DEBUG cinder.coordination [None req-b1d5de87-8849-4c8b-81db-a6c2fc6d3d3f tempest-CinderUnicodeTest-1427111057 None] Lock "cinder-dd0c8013-73df-41c2-944c-bf6e99f05927-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=84402) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:24:08 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:UPDATE=126,cinder:SELECT=75,cinder:INSERT=28,cinder:DELETE=11 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:24:09 devstack cinder-volume[84402]: DEBUG dbcounter [-] [84402] Writing DB stats cinder:SELECT=81,cinder:INSERT=34,cinder:UPDATE=112,cinder:DELETE=6 {{(pid=84402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}